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[57] ABSTRACT 

Solid-state imaging apparatus for producing an image signal 
has an active pixel region comprised of a plurality of active 
light receiving pixels for converting incident light to an 
image signal, and an optical black region disposed al the 
peripheral portion of the active pixel region and comprised 
of a plurality of pixels having a surface provided with a light 
shield. At least one pixel in the optical black region is 
located at a predetermined position and produces a position 
reference signal of a level which differs from that produced 
by the remaining pixels in the optical black region. 

7 Claims, 6 Drawing Sheets 
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SOLID-STATE IMAGING APPARATUS 
INCLUDING A REFERENCE PIXEL EV THE 
OPTICALLY-BLACK REGION 

This is a continuation-in-part of application Scr. No. 5 
08/045,126, filed Apr. 12, 1993 now abandoned. 

BACKGROUND OF THE INVENTION 

This invention relates to a solid-state imaging apparatus, iq 
and more particularly, to a solid-state imaging apparatus 
including an active pixel region comprised of a plurality of 
active light receiving pixels to produce output signals as a 
function of impinging light and an optical black region 
arranged at the periphery of the active pixel region and ^ 
comprised of a plurality of pixels which are effectively 
non-responsive to impinging light. 

In a solid-state imaging apparatus using CCDs (Charge 
Coupled Devices), when signal processing is carried out for 
every light image pickup element, or pixel (cell), for 20 
example, when correcting for a defective pixel, or providing 
digital shading correction, etc., a timing signal from a timing 
generator is used as a pixel position reference signal. In a 
so-called self-contained video camera, the timing generator 
is included in a camera control circuit which is contained, or 25 
housed, in the camera body. 

Anon-self-contained video camera is formed of a camera 
head unit which includes an optical system, an imaging 
section which is comprised of the pixels, etc., and a separate 
camera control unit (CCU) for controlling the operation of 30 
the video camera. A measurable time delay is imparted to the 
transmission of a video signal from the camera head unit to 
the camera control unit, giving rise to a delay of the video 
signal. Likewise, a timing signal from the timing generator 
in the CCU, and which is supplied to the camera head unit 35 
for the purpose of driving die CCDs, undergoes a delay. 
Such delays often are changeable as a function of tempera- 
ture, age and other factors, and thus are unpredictable. For 
this reason, it is difficult, if not impossible, simply to use a 
signal from the timing generator as a pixel position reference 40 
signal. Although it is conceivable to use the horizontal 
synchronizing signal as a reference, it is difficult to insure 
the accuracy thereof for use as a reference it for an indi- 
vidual pixel. 

45 

OBJECTS OF THE INVENTION 

Therefore, an object of this invention is to provide a 
solid-state imaging apparatus adapted for outputting a pixel 
position reference signal together with an image signal. 50 

Another object of this invention is to provide apparatus 
for detecting and compensating for a defective pixel in a 
CCD pickup unit. 

Various other objects, advantages and features of the 
present invention wit! become readily apparent from the 55 
following detailed description and the novel features will be 
particularly pointed out in the appended claims. 

SUMMARY OF THE INVENTION 

60 

In accordance with this invention, a ■ solid-state CCD 
video imaging apparatus comprises an active pixel region 
formed of a plurality of active light receiving elements, or 
pixels, for converting incident light to a video signal, and an 
optical black region disposed at the periphery of the active 65 
pixel region and comprised of a plurality of pixels on whose 
surface is provided a light shield or light screen. A prede- 
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termined pixel within the optical black region is caused to 
generate a pixel position reference signal whose level differs 
from the level of the output signals produced by the other 
pixels in the optical black region. As a result, when the 
active and optical black regions are scanned during norma] 
operation of the CCD apparatus, both the image signal and 
the pixel position reference signal are produced If an active 
pixel is defective, the signal produced by that pixel is 
compensated. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1A is a schematic diagram showing an embodiment 
of a solid-state CCD imaging apparatus according to this 
invention; 

FIG. IB schematically represents the output signals pro- 
duced by a row of pixels in FIG. 1A; 

FIG. 2 is a schematic cross-sectional view for explaining 
the structure of an active pixel of the solid-state imaging 
apparatus shown in FIG. 1; 

FIG. 3 is a schematic view of the structure of a pixel in 
the optical black region of the imaging apparatus; 

FIG. 4 is a schematic view of one embodiment of a 
reference pixel in the optical black region; 

FIG. 5 is a schematic view of another embodiment of the 
reference pixel; and 

FIG. 6 is a block diagram of apparatus for detecting and 
compensating the image signal produced by a defective 
pixel. 

DETAILED DESCRIPTION OF PREFERRED 
EMBODIMENTS 

Preferred embodiments of this invention will now be 
described with reference to the attached drawings. 

FIG. 1 A illustrates the configuration of an embodiment of 
a solid-state CCD imaging apparatus according to this 
invention and FIG. IB schematically illustrates the signals 
produced by that apparatus. 

FIG. 1A includes an active pixel region 11 formed of a 
plurality of pixels 12 arranged in a two-dimensional matrix 
extending lengthwise and breadthwise. Light irradiated 
through a lens system (not shown) is effectively received in 
region 11 to produce output image signals at each pixel. An 
optical black region extends over the right side portion 15H 
and the lower side portion 15V around the periphery of 
active pixel region 11. This optical black region is such that 
incident light is blocked from impinging thereon; for 
example, an aluminum film is deposited and formed on the 
surface thereof as a light shield or light screen (referred to 
herein as a shield). No light is detected in the optical black 
region, and a signal having a predetermined black level 
(optical black level) is thus outputted therefrom at all times. 

in accordance with this invention, a predetermined num- 
ber of position reference pixels 16 are disposed at predeter- 
mined positions within the optical black region 15 to output 
a signal of a fixed level which is different from the optical 
black level. In the example of FIG. 1A, a single horizontal 
position reference pixel 16H is provided at the right side 
portion 15H within the optical black region 15 and a single 
vertical position reference pixel 16V is provided at the lower 
side ponion 15V within the same region. 

FIG. IB is illustrative of an example of an output video 
signal waveform produced when a line (scanning line) of 
pixels including the horizontal position reference pixel 16H 
is scanned. The time period T A of this waveform corre- 
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sponds to the lime period during which the pixels in the 
active pixel region 11 are scanned, and the time period T B 
thereof corresponds to the time period during which the right 
side portion 15H of the optical black region 15 is scanned. 
The signal produced during this time period T B exhibits a 5 
predetermined optical black level V fi *. However, when the 
horizontal position reference pixel 16H is scanned, a pulse 
R H is generated at a level different from the optical black 
level V BK . The detection of this pulse level R„ is used as a 
pixel reference position signal. *0 

Since the pixel reference position signal is derived from 
the video signal itself, thai is, from the image signals 
produced by the CCD imaging apparatus, even if a delay is 
imparted to the transmission of the image signals from the 
camera head unit to the camera control unit, as is expected 15 
in a non-self-contained video camera, there is no difficulty in 
using the pulse R H as a reference signal because this 
reference signal undergoes the same delay as the active 
portion (or image information portion) of the image signal. 
Hence, video information from particular pixels referenced 20 
to this position reference pixel may be sensed with high 
accuracy. 

While the horizontal position refxence pixel 16H is used 
as a reference position in the horizontal direction, vertical 
position reference pixel 16V may be used as a reference 
position in the vertical direction. 

The above-mentioned position reference pixel 16H or 
16V may be located at any desired position in the horizontal 
or vertical direction within the optical black region 15. 3Q 
Hence, when the operating parameters for the video camera 
timing generator are being selected, as during the manufac- 
ture thereof, the coordinates of the position reference pixels 
may be freely set. In order to output a signal of a fixed level, 
such as Rjy, which can be readily discriminated from the 35 
optical black level V BK when the position reference pixel 
16H or 16V is scanned, it'is proposed to remove the light 
shield (such as the aluminum film or the like) normally 
deposited on the pixels in the optical black region, to thereby 
open a window only at the reference position in this portion. w 
Another proposal for the position reference pixel is to 
provide a light emitting element, such as an element capable 
of emitting an infrared ray or the like, formed on a chip 
disposed opposite the usual light receiving section (sensor 
section) of the position reference pixel; and to form a light 4S 
shield, such as the usual aluminum film, so that no external 
light impinges onto the position reference pixel except for 
the light that is emitted by the light emitting chip. When 
using such a light emitting chip, it is appreciated that 
suitable precautions should be taken to obviate, or at least 50 
minimize, the transmission, leakage, or diffraction of light 
onto other portions of the optical black region from the light 
emitting chip. 

As a further proposal, the position reference pixel may be 
constructed to produce a larger dark current (dark current 55 
quantity) from the light receiving section (sensor section) 
thereof by omitting from the position reference pixel the 
positive hole storage layer normally overlying the n+ region 
of the sensor section. As a result, the surface state is in 
correspondence with a depleted state only at the position ^ 
reference pixel in the optical black region. Reference is 
made to the solid-state imaging apparatus described in 
"High Sensitivity Interline type CCD of minimum illumi- 
nance 51 x" Nikkei Micro Device, October. 1987. pp. 60-67. 

An active pixel adapted to be used in active pixel region 65 
U of FIG. 1A is described in the above-mentioned literature 
and is schematically illustrated herein in FIG. 2. This active 
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pixel is adapted to store positive holes on the surface of a 
substrate to thereby suppress the dark current which other- 
wise would be generated. The structure of a single pixel 20 
is comprised of a light receiving secuon (sensor section) 21, 
a readout gate 22, a vertical register 23, and a channel 
stopper 24. A first p-well region 26 is formed on an n-type 
silicon substrate 25. An n* region 27 is formed at the sensor 
section 21 within the p-well region 26. Further, a positive 
hole storage layer 28 is formed above the n* region 27. 

In the vertical register 23, a second p-well region 29 is 
formed within the first p-we!l region 26, and an n* region 30 
is formed above the second p-well region 29. The channel 
stopper 24 is comprised of a p* region 31 formed above the 
p-well region 26. 

A Si0 2 film 32 is formed as an insulating layer by 
depositing same on the upper surface of n* region 30, p-well 
region 26, positive hole storage layer 28 and p* region 31. 
A polycrystalline Si layer 33 serving as an electrode is 
formed in the Si0 2 film so as to cover the readout gate 22, 
the vertical register 23 and the channel stopper 24 through 
the Si0 2 insulating layer. Further, an Al (aluminum) layer 34 
is deposited on the upper surface of the Si0 2 insulating layer 
and serves as a light shield That portion of the Al layer 34 
which overlies sensor section 21 is removed to permit light 
to pass through the transparent Si0 2 layer. 

In general, solid-state imaging devices, whether they 
exhibit high or low sensitivity, admit of a problem when 
imaging is carried out at low luminance because of the 
dominant fixed pattern noise attributed to dark current rather 
than light shot noise. To improve the sensitivity of the 
imaging device, the absolute value of the dark current is 
reduced. 

Dark current includes, as a main component, a diffusion 
current which flows into the pixel from the substrate or the 
neutral region, a current produced as a result of the surface 
state of the sensor section and a current produced as a result 
of the surface state of the vertical register section. In order 
first to reduce the current component (i.e. electrons) which 
flows into the pixel by diffusion from the substrate, the 
p-well region 26 is formed on the n-type substrate 25 so as 
to particularly allow the p-well region to operate in a 
depleted state, thus to substantially completely suppress the 
diffusion component from the neutral region. With respect to 
the current produced on the surface of the sensor section, 
positive hole storage layer 28 allows positive holes to be 
stored and thereby suppress this current, as described more 
particularly in U.S. patent application Ser. No. 08/34,784. 
The current produced on the surface of the vertical register 
secuon is also suppressed in accordance with a similar 
principle. Positive holes are stored by a voltage applied to 
the gate electrode (the polycrystalline Si layer 33), thus to 
reduce the absolute value of that component of the dark 
current produced from the surface of the vertical register 
section 23 

Pixels having the structure shown in FIG. 2 are disposed 
in the active pixel region 11 of FIG. 1 and pixels having a 
similar structure, but wherein the light shield, or Al layer 34, 
extends over sensor section 21, as shown in FIG. 3, are 
disposed in the optical black region 15. A pixel having the 
structure shown in FIG. 4 is used as the position reference 
pixel. Here, the positive hole storage layer 28 overlying the 
sensor section 21 of FIG. 3 is omitted and the n~ region 27 
extends to the.Si0 2 insulating layer As a result, the sensor 
secuon 21 of the pixel shown in FIG. 4 operates in a depleted 
state so that the dark current at this portion (horizontal and 
vertical position reference pixels 16H, 16V) is larger than 
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the dark current at other portions of the opticaJ black region. 
Consequently, a signal of a fixed level greater than the 
optical black level V flie is obtained; and this signal can be 
delected as the pixel position reference signal R H . 

Yet another embodiment of a pixel structure which can be 
used as the position reference pixel is illustrated in FIG. 5. 
Here, the pixel structure used" in the opucai black region, and 
shown in FIG. 3, is modified by depositing in the Si0 2 
insulating layer 32 a light-emitting element 35 formed of 
Bi l2 Si0 20 , generally referred to as a BSO chip. When a 
voltage is applied to the polyciystalline layer 33, the BSO 
chip is activated to emit light which passes through the 
transparent Si0 2 insulating layer to produce a current which 
results in a readily detectable level that is substantially 
greater than the opucai black level \ BK . Thus, when the 
position reference pixel shown in FIG. 5 is scanned, the 
signal produced thereby is indicative of the scanning of 
horizontal position reference pixel 16H or vertical position 
reference pixel 16V, respectively. 

It is readily appreciated that, since the position reference 
pixel having the structure shown in FIG. 4 or FIG. 5 
produces an easily detectable signal, the occurrence of that 
signal as pixels in the optical black region are scanned 
results in a reference signal, such as the reference pulse R w 
shown in FIG. IB, which can be used as a reference position 
from which any one of the active pixels located in active 
region 11 can be precisely identified. The manner in which 
the position reference pixel is used to identify pixels in the 
active region, and to accurately detect and compensate for a 
defective pixel now will be described in conjunction with 
the block diagram shown in FIG. 6. 

FIG. 6 illustrates a non-self-contained video camera com- 
prised of a camera head unit 100, a camera control unit 102 
and a cable 104 which supplies image signals from the 
camera head unit to the camera control unit and also supplies 
synchronizing signals from the camera control unit to the 
camera head unit. The camera head unit includes a solid- 
slate imaging device, illustrated herein as a CCD pickup 106 
which may have the structure magrairunatically illustrated in 
FIG. 1A. It is appreciated, therefore, that CCD pickup 106 
includes an array of active pixels disposed in an active 
region 11, an array of optical black pixels disposed in an 
opucai black region 15 and position reference pixels 16H 
and 16V which may exhibit the structure shown in FIGS. 4 
or 5. Camera head unit 100 additionally includes a sampling 
circuit 108, which may be a correlated double sampling 
(CDS) circuit, a sample signal processor 110, a CCD driver 
112 and a timing generator 114. As shown, CCD pickup 106 
is driven by CCD driver 112 which, in turn, operates to scan 
the active and optical black pixels included in the CCD 
pickup in response to timing signals supplied to the CCD 
driver by timing generator 114. The timing generator is, in 
turn, driven by synchronizing signals supplied thereto from 
camera control unit 102 via cable 104. In the illustrated 
embodiment, these synchronizing signals are generated in 
the camera control unit by a sync generator 120. It will be 
appreciated that, because of the length of cable 104, a lime 
delay is imparted into the synchronizing signals supplied to 
timing generator 114 from sync generator 120 Thus, from 
the viewpoint of considering the synchronizing signal pro- 
duced at the sync generator, there is a discrete time delay 
between that synchronizing signal and the reading of a 
corresponding pixel as that pixel is scanned by CCD dnver 
U2. 

Processor 110 functions to adjust the gam, black level, 
etc., of the sampled levels produced by each pixel as those 
pixels arc scanned by CCD driver 112 Hence, and as is 
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known to those of ordinary skill in the an, processor 110 
produces suitably adjusted pixel image signals. These pixel 
image signals are supplied to camera control unit 102 over 
cable 104; and a further delay relative to the aforementioned 

5 synchronizing signal produced by sync generator 120 is 
introduced into the pixel image signal that eventually 
reaches the camera control unit 

The camera control unit includes an analog-to-digiial 
( A/D) converter 124, a hold circuit 134, a gamma correction 

io circuit 136 and an encoder 138. During normal operation, 
that is, if ii is assumed that none of the active pixels included 
in CCD pickup 106 is defective, each pixel image signal 
supplied to the camera control unit is converted from analog 
form to digital form by A/D convener 124, and each digital 

s pixel image signal then is gamma-corrected by gamma 
corrector 136 and suitably encoded by encoder 138. The 
resultant encoded image signals are provided at an output 
terminal 140. During such normal operation, hold circuit 
134 provides no active function and simply supplies to 

20 gamma corrector 136 each digitized pixel image signal. 
It is expected, however, that in manufacturing CCD 
pickup 106, one or more active pixels may be defective. That 
is, when light impinges upon a defective active pixel, the 
pixel signal produced thereby is not an accurate represen- 
ts tation of the impinging light In that event, rather than supply 
to output terminal 140 an error image signal, it is preferred 
simply to replace the erroneous signal produced by this 
defective pixel with the correct image signal produced by an 
adjacent efficacious pixel. For example, the pixel image 

3 0 signal produced by the preceding active pixel is used in 
place of the erroneous pixel image signal produced by the 
defective pixel. Hold circuit 134 thus operates to tempo- 
rarily store, or hold, a pixel image signal for a time period 
substantially equal to the time needed to scan two successive 

35 pixels. As a result, the temporarily stored pixel image signal 
in hold circuit 134 is used once again in the event that the 
next pixel image signal is erroneous. Of course, if the next 
pixel image signal is correct, the temporarily stored preced- 
ing pixel image signal is not used. Rather, this next correct 

40 pixel image signal is supplied to gamma corrector 136. Hold 
circuit 134 is selectively operated, that is, it is selectively 
triggered to use once again the pixel image signa) tempo- 
rarily stored therein, by a frame memory 132. 
Frame memory 132 stores a corresponding representation, 

45 or map, of all of the active and optical black pixels included 
in CCD pickup 106. Thus, the frame memory may be 
thought of as a memory device which stores an array of 
signals, or flags, corresponding to the pixel arrangement 
shown in FIG. 1A. Preferably, frame memory 132 stores a 

50 "0'* at those locations corresponding to non-defective pixels, 
specifically non-defective active pixels, and stores a **1" at 
those locations corresponding to defective active pixels. For 
convenience, each "1" may be thought of as a flag that is set 
and each "0" may be thought of as a flag that is reset. It is 

55 known to test all of the active pixels one-ai-a-time during the 
manufacturing of CCD pickup 106. As a result of such 
testing, each non-defective active pixel is known and each 
defective active pixel likewise is known. That is, the loca- 
uon, or coordinate, of each defective pixel is known and its 

60 corresponding location in frame memory 132 is loaded with 
a flag, or "1", which represents that such active pixel is 
defective Thus, when a pixel image signal produced by a 
defective pixel is supplied to camera control unit 102, frame 
memory 132, which stores the location of that defective 

65 pixel and, thus, senses when the pixel image signal supplied 
to the camera control unit is from that defective pixel, 
energizes hold circuit 134 to supply io gamma corrector 136 
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the temporarily stored pixel image signal that had been 
produced by the preceding non-defective pixel. 

Typically, frame memory 132 is addressed by a scan 
signal generator 150 which, in turn, is driven by a clock 
generator 122. This clock generator also drives A/D con- 5 
verter 124 and sync generator 120. The scan signal generator 
thus is expected to be driven in synchronism with sync 
generator 120 which, in turn, is expected to synchronize the 
scanning of CCD pickup 106 by CCD driver 112. As a result, 
when pixel 1 supplies a pixel image signal to camera control 10 
unit 102, scan signal generator 130 is expected to generate 
an address for frame memory 132 which corresponds to the 
location therein of pixel 1. Likewise, when the pixel image 
signal produced by pixel 2 is supplied to the camera control 
unit, scan signal generator 130 is expected to address 15 
memory 132 representing the location therein corresponding 
to pixel 2. As a result of this addressing, it is expected that 
when the image signal produced by pixel n is supplied to the 
camera control unit, a corresponding location in frame 
memory 132 is addressed. If that corresponding location has 20 
a T' flag stored therein, thus representing that pixel n is 
defective, hold circuit 134 is triggered and the otherwise 
erroneous pixel image signal is compensated by replacing 
that pixel image signal with the previous correct pixel image 
signal. However, as a result of the aforementioned delay ^ 
imparted to the synchronizing signal supplied from sync 
generator 120 to timing generator 114 and the further delay 
imparted to the pixel image signal supplied to A/D converter 
124 from processor 110, it is possible and even likely that, 
when the pixel image signal produced by pixel n is received 3Q 
by the camera control unit, scan signal generator 130 
addresses a location in memory 132 corresponding to pixel 
(n-1). It will be appreciated, therefore, that because of this 
delay, an erroneous pixel image signal may, nevertheless, be 
supplied to gamma corrector 136 and the next-following 35 
correct pixel image signal may be replaced by the preceding 
erroneous signal. 

This possible erroneous defective pixel compensation 
operation is avoided by the present invention which serves 
to reset, or preset, scan signal generator 130 to generate a 40 
predetermined memory address when position reference 
pixel 16H or 16V is scanned. This presetting of the scan 
signal generator is achieved by a reference detector 126 and 
a window generator 128, as will now be described. 

Reference detector 126 may be a comparator supplied 45 
with a reference signal, diagrammatically represented as 
being supplied by a reference source 127, and is adapted to 
compare to this reference signal the digitized pixel image 
signals produced by A/D converter 124. Reference detector 
126 is enabled by window generator 128, the latter being 50 
driven by sync generator 120. It will be appreciated that the 
delay attributed to cable 104 is no greater than the time 
needed to scan one, two or three successive pixels of CCD 
pickup 106. Thus, window generator 128 operates to gen- 
erate a window pulse having a duration equal to the greatest 55 
delay imparted by cable 104 such that this window suffi- 
ciently surrounds the scanning of position reference pixel 
16H. The window generator also may be driven by sync 
generator 120 to generate another window pulse which 
effectively surrounds the scanning of reference position 60 
pixel 16V. It will be recognized that suitable timing is used 
in window generator 128 to respond to the synchronizing 
signal produced by sync generator 120 to generate the 
aforementioned window pulses. Such timing will be readily 
and easily implemented by one of ordinary skill in the art. 65 
Thus, even with the expected but unpredictable delay attrib- 
uted to cable 104, window generator 128 generates a win- 
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dow pulse when the pixel image signal produced by refer- 
ence position pixel 16H is supplied to the camera control 
unit and also generates a window pulse when the pixel image 
signal produced by reference position pixel 16V is supplied 
to the camera control unit. 

Since the reference position pixels assume the structure 
shown in FIG. 4 or FIG. 5, thus producing a reference pixel 
image signal of the type shown as reference pulse R„ in FIG. 
IB, reference detector 126 readily detects the occurrence of 
this reference pulse within the window generated by window 
generator 128. For example, the reference signal supplied to 
the reference detector by reference source 127 may be a 
threshold level greater than the black level V BK , but less than 
the expected level of the reference pulse R„. Consequently, 
when reference position pixel 16H is scanned, reference 
detector 126 presets scan signal generator 130 to an address 
corresponding to this reference position pixel, thereby 
addressing memory 132 at a location which also corresponds 
to this reference position pixel. Thereafter, the scan signal 
generator may be incremented by clock generator 122 to 
generate successive addresses for frame memory 132; and it 
will be readily appreciated that such successive addresses 
now are in synchronism with the pixel image signals sup- 
plied to camera control unit 102 by the corresponding pixels 
of CCD pickup 106. Likewise, the detection of the pixel 
image signal produced by position reference pixel 16V 
presets scan signal generator 130 to address a location in 
memory 132 which corresponds to this reference position 
pixel. 

Therefore, even though cable 104 may impart a delay to 
the pixel image signals supplied to the camera control unit 
relative to the clock signals produced by clock generator 
122, and even though this delay may not be accurately 
predictable, nevertheless the detection of the pixel image 
signals produced by the position reference pixels serves to 
synchronize the addressing of memory 132 with the recep- 
tion of the pixel image signals produced by the active pixels, 
thereby permitting proper compensation when a defective 
pixel is scanned. 

While the present invention has been particularly shown 
and described with reference to preferred embodiments, it 
will be readily appreciated by those of ordinary skill in the 
an that various changes may be made. For example, only a 
single reference position pixel can be used or, alternatively, 
three or more reference position pixels can be provided in 
the optical black region. Of course, the coordinates of the 
respective reference position pixels will be set when the 
CCD pickup is manufactured, and these coordinates are 
represented by the presetting of scan signal generator 130 
when the corresponding reference position pixel is detected. 

It also is contemplated that the reference position pixel 
need not be limited to the embodiment shown in FIG. 4 or 
the embodiment shown in FIG. 5. Rather, the reference 
position pixel may adopt the very same structure as the 
active pixel shown in FIG. 2. With this construction, the 
reference position pixel produces an output signal whose 
level is equal to that shown in FIG. IB during the active 
scanning period T 4 , and this output signal is produced as a 
result of light impinging upon the reference position pixel. 

It is intended that the appended claims be interpreted so 
as to cover the embodiments discussed above, those changes 
which have been mentioned and all equivalents thereto. 

What is claimed is: 

1. A solid-state imaging apparatus for producing an image 
signal, comprising: 

an active pixel region comprised of a plurality of active 
light receiving pixels for converting incident light to an 
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image signal, said active pixel region having a periph- 
eral portion; and 
an optical black region disposed at said peripheral portion 
of said active pixel region and comprised of a plurality 
of pixels having a surface provided with a light shield, 5 
at least one of the pixels in said optical black region 
having an opening in said light shield for the passage of 
light, said at least one pixel being located at a prede- 
termined position within said optical black region, to 
produce a reference position signal detectable relative 10 
to signals produced by the remaining pixels in said 
optical black region. 

2. A solid-state imaging apparatus for producing an image 
signal, comprising: ^ 

an active pixel region comprised of a plurality of active 
light receiving pixels for converting incident light to an 
image signal, said active pixel region having a periph- 
eral portion; 

an optical black region disposed at said peripheral portion 20 
of said active pixel region and comprised of a plurality 
of pixels having a surface provided with a light shield; 
and 

a predetermined one of the pixels in said optical black 
region having a sensor section, an insulating layer 25 
separating said sensor section from said light shield, 
and light emitting means positioned in said insulating 
layer between said light shield and said sensor section 
to irradiate light to said sensor section to produce a 
reference position signal detectable relative to signals 30 
produced by the remaining pixels in said optical black 
region. 

3. A solid-state imaging apparatus for producing an image 
signal, comprising: 

an active pixel region comprised of a plurality of active 35 
light receiving pixels for converting incident light to an 
image signal, said active pixel region having a periph- 
eral portion; and 

an optical black region disposed at said peripheral portion 
of said active pixel region and comprised of a plurality 40 
of pixels each having a surface provided with a light 
shield, a sensor section and a positive hole storage layer 
overlying said sensor section to minimize dark current 
reproduced by said pixel; and wherein at least one 
predetermined pixel in said optical black region having 45 
said positive hole storage layer omitted therefrom to 
produce a dark current of a magnitude greater than said 
minimized dark current, thereby producing a reference 



10 

position signal detectable relative to signals produced 
by the remaining pixels in said optical black region. 

4. A solid stale imaging apparatus, comprising: 

an active pixel region comprised of a plurality of active 
light receiving pixels for converting incident light to an 
image signal, each active pixel having a structure 
which includes a sensor section and an insulating layer 
overlying said sensor section; and 

an optical black region disposed adjacent said active pixel 
region, said optical black region being comprised of a 
plurality of optically black pixels for producing a black 
signal level, each optical black pixel having a structure 
substantially similar to the structure of said active pixel 
and additionally including a light shield provided on a 
surface thereof and overlying said sensor section, said 
optical black region being additionally comprised of at 
least one position reference pixel located at a prede- 
termined position in said optical black region and 
having a structure which differs from the structure of 
said optical black pixels to produce a reference position 
signal detectable relative to signals produced by said 
optical black pixels. 

5. The apparatus of claim 4 wherein said position refer- 
ence pixel includes a p-well region, an insulating layer 
overlying said p-well region, a light shield overlying said 
insulating layer, a sensor section disposed in said p-well 
region, and a light transmissive opening in said light shield 
overlying said sensor section. 

6. The apparatus of claim 4 wherein said position refer- 
ence pixel includes a p-well region, an insulating layer 
overlying said p-well region, a light shield overlying said 
insulating layer, a sensor section disposed in said p-well 
region, and a light emitting element in said insulating layer 
between said light shield and said sensor section to irradiate 
light to said sensor section. 

7. The apparatus of claim 4 wherein each optical black 
pixel includes a position hole storage area included in said 
sensor section to suppress dark current produced by said 
active pixel; and wherein said position reference pixel 
includes a p-well region, an insulating layer overlying said 
p-well region, a light shield overlying said insulating layer 
and a sensor section disposed in said p-well region, said 
sensor section omitting a positive hole storage area to 
increase the dark current produced by said position reference 
pixel. 

***** 
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[57] ABSTRACT 

A zoom lens magnification control mechanism for a 
photoprint digitizing scanner contains an adjustable 



focus, zoom lens. The photoprint image projection path 
is incident upon a high resolution CCD sensor, image 
output signals from which are digitized for storage on a 
compact disc. Control of the operation of the scanner 
includes the use of a display device to which output 
signals provided by the photosensor are coupled so as to 
display the projected image. Whenever a photoprint is 
presented to the scanner an indication of the size of the 
photoprint is provided, as by way of a code stored on a 
photoprint platen, in order to set the magnification 
setting of the zoom lens. The photofinisher observes the 
display of the image projected on the photosensor and 
adjusts, as necessary, the operation of the zoom lens so 
that the image displayed by the display device fits the 
display screen. Using a program feature of a user inter- 
face, the photofinisher stores in memory information 
representative of the adjustment of the operation of 
zoom lens. Then, for subsequent presentations of photo- 
prints to the scanner, the stored adjustment information 
is used as a magnification setting default value for a 
respective photoprint size. Whenever the magnification 
of the zoom lens is adjusted, there is an accompanying 
change in the focus ring of the lens, so that the dis- 
played image is maintained in focus. 

39 Claims, 12 Drawing Sheets 
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tates retrieval of tbe digitized images for reproduction 
PRINT SCANNER WITH SOFT KEY VARIABLE by a variety of devices the resolution of which may 
MAGNIFICATION vary from device to device, such as a low/moderate 

NTSC television monitor or a very high resolution, 
FIELD OF THE INVENTION 5 digitally driven, color thermal printer. The spatial pa- 

The present invention relates to a photoprint digitiz- mrneters of each of the hierarchical image files into 
ing scanner having a variable magnification zoom lens, which an original 2K pixel x3K pixel digitized image 
respective magnification and focus settings for which fite is encoded and stored are chosen to facilitate the 
may be changed in order to accommodate different implementation and incorporation of a low cost, re- 
sized photoprints, and is particularly directed to a 10 duced complexity frame store/data retrieval architec- 
mechanism for adjusting, storing and retrieving default rare into a variety of reproduction devices, thereby 
magnification and focus settings for a zoom lens, so as to providing for rapid call-up and output (display or print 
facilitate sequential scanning of a plurality of photo- out) of one or more selected images, 
prints having similar dimensional characteristics. In addition to using such improved photofmishing 

BACKGROUND OF THE INVENTION " ^^^^ d^^fy^f 

Recent improvements in their spatial and data resolu- a high resolution digitizing color camera, or scanning a 

tion capabilities have made digital color image process- roll of color negative film, there is also the demand for 

ing systems attractive for a number of photoprocessing using such digital image processing capability to con- 

(e.g. photCKlmishing) applications. In still color image 20 vert *old* photographs, such as dated photoprints that 

photography, for example, once an image (such as that have been kept in a loose pile in a *shoebox\ or mounted 

captured on color photographic film or a high resolu- - m a fe^y p h oto album, into digital format for CD 

tion color digital camera) has been digitized and stored storage, thereby allowing a customer to store and cata- 

in an attendant data base, it is readily optimized for log thc on sucb prin|5 for subsequent television 

reproduction by means of photofmishing image pro- zs viewing 

cessing software. Such image processing systems also In consideration of this need, co-pending U.S. patent 

provide for the storage and retrieval of high resolution application ^ Na 762 , 3 23, filed Sep. 16. 1991, by K. 

digitized color stiB images for applicauon to a variety of A ParuJski 4 A CTtitJed .. Dua] ljn ^ Station Scan . 

reproduction device > This not only enables the photo- ner «, to the assignee of the present application 

finisher to optimize the quality of a color image print, 30 Sisclosure of which is herein mcorporated, 

but allows the images on a processed roll of mm to be rf dfeWzing scanner apparatus which has the 

stored in digital format on a compact disc CCD), which ^ . « " " . . 

may then bf delivered to the customer fo/playback by *** to ^m-ticaUy digit*e ; a plurahty of photoprint 
a CD player and display on a television set w * tch *e customer bnngs to the photofinisher 

One such apparatus is described in co-pending U.S. 35 » ***** frayed P« e « mounted m a photo-album 
patent application Sen No. 582,305. filed Sep. 14, 1990, * b,ndcr ' a P hotof ?f*f to rapidly pro- 

entitled "Multiresolution Digital Imagery Photofinish- »* rmmber of pictures provided by the customer, 

ing System," by S. Kristy, assigned to the assignee of respective of the condition or form in which the pbo- 

thc present application and the disclosure of which is topnnts are supplied. 

herein incorporated. As diagrammatically illustrated in 40 More particularly, FIG. 2 is an exterior perspective 
FIG. I, such a digitizing apparatus may employ a high ww » whlle RGS 3 ** d 4 «* diagrammauc respective 
resolution optoelectronic film scanner 12, the output of from side views of intcra at architecture of a 
which is coupled to a host digitized image processor dual waging station, photopnnt digitizing scanner de- 
frost computer) 14. Scanner 12 typically contains a scribed in the above-referenced Parulski et al applica- 
very high resolution sensor pixel array (e.g. a 45 tion. The scanner, which is shown generally at 10, pref- 
3072x2048 pixel matrix) capable of generating high crably comprises a housing or cabinet 11, having an 
spatial density-representative output signals which, upper, horizontally translatable umt 13, which supports 
when converted into digital format, yield 'digitized' a large area imaging station 15 for viewing an individual 
photographic image files from which high quality color photoprint either by itself or retained on a page of a 
prints may be obtained. Scanner 12 is arranged to be 50 photo album or the like. Beneath unit 13 (and upper 
optically coupled with a photographic recording me- imaging station IS) is a lower, magazine-fed platen im- 
dium, such as a consumer-supplied 35 mm color film aging station 17. Translatable unit 13 is supported for 
strip 16. Film strip 16 contains a plurality (e.g. a set of hack and forth horizontal movement (or translation) in 
twenty- four or thirty-six) 36 mm X 24 mm color image the direction of arrows A, cither manually or by a drive 
frames. For each scanned image frame, high resolution 55 motor (not shown), for the purpose of bringing a de- 
scanner 12 outputs digitally encoded data, representa- sired portion of imaging station 15 into optimum regis- 
tive of the opto-electronic response of its high resolu- tration with viewing optics through which a photoprint 
tion imaging sensor pixel array, onto which a respective is imaged onto a downstream opto-electronic image 
photographic image frame of film strip 16 is projected sensor. 

by the scanner's input lens system. 60 The upper imaging station 15 comprises a transparent 

This digitally encoded data, or 'digitized* image, is (e.g. glass) plate 21 upon which an individual sheet of 

supplied in the form of an imaging pixel array- represen- photographic recording material, such as a photoprint, 

tative bit map, resolved to a prescribed code width (e.g. 23 may be placed in a face-down condition. Adjacent to 

eight bits per color per pixel), to a host processor 14. top plate 21, translatable unit 13 has a sloped support 

Host processor 14 contains an image encoding and stor- 65 surface 25, thereby providing, in cooperation with top 

age operator through which each high resolution digi- plate 21, a broad area surface for supporting a large 

tized image file is stored, preferably in a multi-resolu- item, such as a photo album (shown diagrammatically in 

tion, hierarchical format. Such a storage format facili- broken lines 27 in its open, face-down condition), so that 
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a page of the photo album may be easily placed in direct above platen imaging station 17, so as to provide effec- 

imaging -abutment with top plate 21. A first imaging tively even illumination of an individual photoprint 

station illuminator 29 comprised of a rectangular con- carried by a platen thai has been transported to imaging 

figuration of a set of four fluorescent lamps is located station 17. 

beneath top plate 21, so as to provide effectively even 5 Supported within housing 11 between upper and 

illumination of a sheet or page of recording material lower imaging stations 15 and 17 is a multi-directional 

that is placed face down on the top plate. image projection mechanism 50. Image projection 

A lower portion of cabinet 11 retains a platen feed mechanism 50 is operable to selectively project the 

mechanism 31, which is operative to withdraw and image of a photoprint at a selected one of imaging sta- 

translate a photographic print 'support platen from a 10 tions 15, 17 onto an opto-electronic image sensor 60, 

first platen supply magazine 32 to a platen imaging such as a high resolution CCD sensor, the 1536x1024 

station 17, and then feed the platen from the platen pixel array of which is electronically scanned and digi- 

imaging station to a second take up platen storage maga- tized to obtain a digitized image, which is stored in an 

zine 34. An individual platen is preferably of a type . attendant fraraestore for subsequent processing. Be- 

detailed in co-pending U.S. patent application Ser. No. IS cause the sizes of photoprints may vary (typically 3R, 

760,437, filed Sep. 16, 1991, entitled "Photoprint Re- 4R and 5R sized prints) image projection mechanism 50 

taining Platen For Digitizing Image Scanner**, by K. A. includes a magnification/focussing unit 52, preferably 

Pamlski et al, assigned to the assignee of the present an adjustable focus zoom lens 54, so that the photoprint 

application and the disclosure of which is herein incor- image that Is projected on the high resolution sensor 60 

po rated. 20 may be adjusted, as necessary, to ensure that the digi- 

A photoprint-support platen as described in that ap- tized image that is written onto a compact disc and 

plication may be generally configured as diagrammati- played back on a customer's home CD player will be 

cally illustrated at 15 in FIG. 5, to facilitate presentation correctly displayed, in focus and filling die screen of a 

of a photoprint to an imaging station of a photoprint customer's television set. 

imaging scanner, in a secure protected condition, while 25 Now although professional photofinishers employ 
also allowing a plurality of photoprint platens to be standardized photoprint sizes, such as the above- men- 
arranged in a stacked configuration and fed one at the tioned 3R, 4R and 5R sizes, in practice, the actual di- 
time to a platen imaging station, and then fed from the mensions of batches of photoprints produced by differ- 
platen imaging station to a take up location. Preferably, ent photofinishers may vary from one another (e.g. by 
a photoprint support- platen includes a photoprint- 30 as much as one-quarter an inch per edge). As a result, 
retention or mounting surface area 19 which contains a employing a fixed magnification default setting for the 
semi-tacky material 20 for removably securing a photo- zoom lens for a given photoprint size wfl] not necessar- 
print to the platen, so that the platen may be re-used ily guarantee that the photoprint will be properly ira- 
with other photoprints. Adjacent to the mounting sur- aged on the scanner's photosensor. In order to accom- 
face area are side rails 22 and the ends 26 of the platen 35 modate variations in photoprint dimensions, the zoom 
are sloped or beveled to facilitate interleaving of multi- lens is adjustable by the photofinisher, who observes the 
pie platens in a stack, without the mounted photoprints image by way of an auxiliary, relatively low resolution, 
being contacted by an adjacent platen. One or more monochromatic 'preview 1 display unit to which the 
image parameter regions 25 are located adjacent to a output of the scanner's image sensor is coupled. When 
photoprint mounting surface area for storing machine 40 the photofinisher is satisfied that the image is properly 
readable photoprint parameter information (e.g. bar sized (and focussed) within the confines of the preview 
codes or adjustable indicator elements). This machine display screen, scanning and digitizing of the photoprint 
readable information is detected by one or more image image as projected onto the image sensor is invoked, 
parameter sensors 30 located in the feed path of platen A shortcoming of such photofinisher participation in 
imaging station 17. The outputs of these sensors are 45 the scanning of each photoprint is the fact that the pre- 
coupled to a microcontroller 38, such as an Intel view operation is time consuming and labor intensive, 
80C196KB microcontroller which controls the opera- and thereby results in an increased cost per processed 
tion of the scanner, including the imaging optics, to print image. Ideally, the zoom lens magnification should 
rapidly project and focus the image on the photoprint be controlled by way of default settings associated with 
onto an opto-electronic image sensor (e.g. a high resolu- 50 each photoprint size. Unfortunately, however, as noted 
tion CCD image sensor) 60. above, different photoprints of a given size (e.g. 3R) do 
The platen feed mechanism comprises a set of con- not necessarily have tie same dimensions. 

^X^tr^^T^oTZ: SUMMARY OF THE INVENTION 

trollably driven pinch rollers 43 located between platen 55 In accordance with the present invention, the need 

imaging station 17 and magazine 34. A controllably for the photofinisher to perform a zoom lens adjustment 

stepped drive motor 45 is coupled to rollers 41 and 43 for each photoprint of a given batch of photoprints is 

by means of a conventional pulley /drive belt arrange- obviated by a lens control mechanism through which 

ment, not shown, and is controllably driven by the default settings for zoom lens magnification and focus 
system microcontroller to rotate the pinch rollers and 60 may be calibrated, as necessary, as a precursor step for 

thereby sequentially extract a platen from a bottom slot processing a plurality of photoprints belonging to a 

33 of supply magazine 32, translate an extracted platen common batch. In particular, the present invention is 

:a imaging station 17 and then translate the platen from directed to a lens control mechanism in which, for a 

imaging station 17 to a lower entry slot 35 of take up given print size, the magnification and focus default 
storage magazine 34. A second imaging station illumina- 65 settings of the projection system's zoom lens may be 

tor 36 comprised of a rectangular configuration of a set readily recalibrated to new values associated with mag- 

of four fluorescent lamps, similar to that of illuminator nification and focus adjustments of the zoom lens 

29 for the first imaging station 15, is located directly through which the photofinisher has optimized the 
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presentation of the photoprint image on a preview dis- grees (vertical images), the user interface includes a 
play monitor to which the output of the scanner's image vertical button which, when depressed, causes the con- 
sensor is coupled. Thereafter, as additional photoprints trailer to store information representative of the verti- 
of the same size of that batch are processed, the repro- cal orientation of the image on the photoprint. This 
grarnrned default settings are used without the need for 5 Vertical' code is stored in a control file on the compact 
adjustment, so that each photoprint will be properly disc so that the image will be displayed upright on play- 
imaged on the scanner's photosensor. back. 

The lens control mechanism of the present invention . MTT . ^„ „ „ > ^„„ 
is especially useful for automatically scanning a series of BRIEF DESCRIPTION OF fHE DRAWINGS 
platen-mounted photoprints, the platens for which con- 10 FIG. 1 diagrammaticaliy shows a photo digitizing 
tain machine readable photoprint parameter mforrna- apparatus described in co-pending U.S. patent applica- 
tion (e.g. bar codes or adjustable indicator elements), as n'on Ser. No. 582,305. filed Sep. 14, 1990, entitled "Mul- 
described above. As such machine readable information ^resolution Digital Imagery Photofmishing System," 
is detected by one or more image parameter sensors by S. Kristy; 

located in the platen feed path, the magnification and 15 FIG. 2 is an exterior perspective view, while FIGS. 3 
focus default settings are used to rapidly adjust the and 4 are diagrammatic respective front and side views 
image projection system, including zoom and focussing of the internal architecture of a dual imaging station, 
ring positions of die zoom lens, so as to facilitate the photoprint digitizing scanner described in the above- 
automatic processing of a plurality of photoprints of a referenced Parulski et al application; 
common batch. 20 FIG. 5 diagrammaticaliy shows a photoprint-support 
More particularly, the image magnification control platen used to feed a photoprint to an imaging station of 
mechanism in accordance with the present invention is a photoprint imaging scanner; 
intended for use with an apparatus, such as the above FIG. 6 diagrammaticaliy shows a zoom lens fitted 
refe~ meed scanner, which is operative to digitize an with magnification and focus adjustment rings; 
image that has been recorded on a photographic record- 25 FIG. 7 is a lens control system diagram of FIG. 7; 
ing medium, such as 35 mm film, and stores the digitized FIG. 8 shows a scanner user interface in the form of 
image on a digital storage medium, such as an optical a set of control buttons; 

compact disc As noted above, within the projection FIG. 9 shows RESET MODE and SLEEP MODE 

path of the scanner is an image projection device con- routines of the control mechanism of the invention; 

taining a variable magnification device in the form of an 30 FIG. 10 shows the operational flow through the 

adjustable focus, zoom lens. The projection path is inci- FRAME mode routine of the control mechanism of the 

dent upon a photo-responsive device, such as a high invention; 

resolution CCD sensor, image outputs signals from FIG. 11 shows the operational flow through the 

which are digitized for storage on a compact disc. Con- FOCUS mode routine of the control mechanism of the 

trol of the operation of the scanner includes the use of a 35 invention; 

display device to which output signals provided by the FIG. 12 shows the operational flow through the 

photosensor are coupled so as to display the projected CAPTURE mode routine of the control mechanism of 

image. the invention; 

Whenever a photoprint is presented to the scanner an FIG. 13 shows such an empirically determined char- 
indication of the size of the photoprint is provided, as by 40 acteristic stored in a focus adjustment look-up table for 
way of a code stored on a photoprint platen, in order to adjusting the focus of the zoom lens as its magnification 
set the magnification setting of the zoom lens. The setting is changed; and 

photofinisher observes the display of the image pro- FIG. 14 shows the operational flow through the 

jected on the photosensor and adjusts, as necessary, the PROGRAM mode routine of the control mechanism of 

operation of the zoom lens so that the image displayed 45 the invention. 

by the display device fits the display screen. Using a hptatt pn nrcri?TPTtr.M 
program feature of a user interface, the photofinisher JJfclAlLbU UtbCKlFlION 
stores in memory information representative of the As described previously* the photoprint scanner de- 
adjustment of the zoom lens. Then, for subsequent pre- scribed in the above-referenced Parulski et al applica- 
sentations of photoprints to the scanner, the stored ad- 50 tion and illustrated diagrammaticaliy in FIGS. 2, 3 and 
justment information is used as a magnification setting 4 t includes a multi*directional image projection mecha- 
default value for a respective photoprint size. When- nism 50, which is operable to controllably project the 
ever the magnification of the zoom lens is adjusted, image of a photoprint, that has been placed or posi- 
therc is an accompanying change in the focus ring of the tioned at a selected one of imaging stations 15, 17, onto 
lens, so that the displayed image is maintained in focus, 55 a high resolution image sensor 60. Because the sizes of 
and substantially fills the display area of the display photoprints may vary, image projection mechanism 50 
device. To capture a high resolution image (four tiroes includes an adjustable magnification/focussing unit 52 
that of the resolution of the image sensor), an optical that preferably contains an adjustable focus zoom lens 
translation dither device is provided which controllably 54, such as a Nikon 35-70 mm zoom lens, 
varies the spatial location at which an image projected 60 Zoom lens 54 is shown diagrammaticaliy in FIG. 6 as 
by the zoom lens device is incident upon the image being fitted with magnification and focus adjustment 
sensor. A color filter mechanism which contains a plu- rings in the form of toothed collars 64 and 65, respec- 
rality of respectively different color filters is rotated so tively. The collars are mounted so that as they are ro- 
that the filters are sequentially inserted in the path of the tated, they are translated along an image projection axis 
projected photoprint image, so that successively se- 65 67, which intersects (and is normal to) the plane of the 
lected color components of the projected image are scanner's high resolution CCD sensor 60. For this pur- 
captured, digitized and stored. For those images which pose, each lens collar 64 and 65 is coupled either di- 
have been captured with a camera rotated ninety de- rectly or through a suitable linkage (e.g. belt and pulley 
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coupling) 74, 75 to a respective stepper motor 84 t 85- operation of a shutter 101 is controlled by a shutter 
The gear ratio and stepper motor resolution are such as controller 103 to define the length of time that the pho- 
to allow fine angular motion of the zoom lens so as to toprint is imaged on sensor 60. Like zoom stepper motor 
permit fine adjustments in both its magnification and 84 and focus stepper motor 85, filter wheel motor 97 has 
focus settings. Respective 'home' or 'reset* position 5 an associated home or reset sensor 96 which establishes 
sensors 94, 95 are arranged along the travel path of lens a reference or reset position for the filter. As a non- 
coliars 64, 65 for detecting when the collars have limitative example, filter wheel 97 may have a home 
reached prescribed reference positions on axis 67. position such that its green filter is disposed in the path 

As illustrated in the lens control system diagram of of the projected image. This home color is used during 
HG. 7, stepper motors 84, 85 are controllably driven by 1Q the preview display of the photoprint image, 
associated motor controllers 104, 105 under the control The photoprint image that is focussed on sensor 60 is 
of microcontroller 38, in response to either operator- read out through a sensor interface 61 to microcon- 
sourced inputs or platen-sourced parameter data, so as troller 38 and to a 'preview* display monitor 40. By 
to control the size and position of the photoprint image observing this "preview* display, the photofinisher is 
that is projected and focussed on CCD sensor 60. Also 15 able to adjust as necessary, via a set of control buttons 
shown in FIG. 7 are the control components for a shut- on a control panel 70 and described below with refer- 
ter and an associated filter wheel which control the ence to FIG. 8, the control parameters of image mag- 
amount of light and color components of photoprint mHcation/focussing unit 52, until the previewed image 
images projected onto sensor 60, as described in co- is optimally focussed and geometrically positioned on 
pending U.S. patent application Ser. No. 575,772, filed 20 the display screen. As will be described, when the 
Aug. 31 » 1990, entitled "Color Sequential Scanner In- photofinisher is satisfied that the image is properly dis- 
corporating A Synchronized Variable Exposure Shut- played, he may depress a 'program' button, which 
ter" by K. A. Parulski et al, assigned to the assignee of causes the magnification and focus settings for a se- 
tae present application and the disclosure of which is lected print size to be stored in a default table, so that 
herein incorporated. 25 the control parameters for the zoom lens will be eiTec- 

As described in that application, advantage is taken of tively calibrated to that photoprint. Thereafter, for 
the improved color balance properties of fluorescent subsequently fed platen-mounted photoprints, the oper- 
lamps, by synchronizing the exposure time of an dec- ation of the image magnification/focussing unit is auto* 
tronic shutter 101 (through which respective red, blue matically referenced to the newly calibrated default 
and green color images of a photoprint are sequentially 30 settings, thereby facilitating rapid scanning of a series of 
captured by high resolution opto-electronic image sen- platen-mounted photoprints. 

sor 60) with the AC power source for the lamps. By As explained above, in order to enable the photofin- 
using a high resolution image sensor, such as a isher to optimally adjust the projection and focussing 
1536 X 1024 pixel CCD image sensor for image sensor parameters of the scanner, such as any required transla- 
60, and effecting a two dimensional optical translation 35 tion of unit 13 and adjustment of zoom lens 54, the 
of the image sensor relative to the projected image output of high resolution CCD image sensor 60 is cou- 
makes it possible to realize a 3072 x 2048 pixel (high pled separately of the high resolution image processing 
resolution) image corresponding to that obtained by the workstation to an auxiliary, lower resolution, mono- 
image pixel matrix of a high resolution image color chromatic 'preview* display unit 40. While it is possible 
image camera. Such a relative dither may be accom- 40 to use the high resolution color display terminal of the 
pushed by either physically translating the image sensor photofinishing workstation for this purpose, from a 
itself or by translating the projected image. practical operational standpoint, the processing time 

In accordance with a preferred embodiment of the required to display the fuD color 3072X2048 pixel 
scanner, the projected image is 'dithered* in the X and Y image is prohibitive. For successful operation of the 
directions on the image plane of CCD sensor 60 by 45 scanner, what is necessary is that, prior to image cap- 
means of an image dither mechanism in the form of a ture, the photoprint be correctly positioned, and its 
canted glass plate, which is inserted in the image projec- image correctly sized and focussed on the image sensor, 
tion path ahead of sensor 60 and sequentially rotated in To satisfy these requirements, during a 'preview' of the 
ninety degree segments so as to cause successively pro- image, the photofinisher does not need to view a full 
jected images to fall on (four) respectively adjacent 50 color image at its highest resolution; a lower resolution, 
regions of the sensor. Capturing and digitizing the monochromatic image will do. 
image that falls on each of these adjacent regions makes In accordance with a preferred embodiment of the 
it possible to realize a 3072 X 2048 high resolution image invention, in order to rapidly preview what is seen by 
output from the CCD image sensor. the CCD image sensor 60 on display 40, sensor output 

For each respective monochromatic image (one of 55 interface 61 preferably includes an auxiliary preview 
red, green and blue) as determined by a sequentially framestore apparatus of the type described in U.S. Pat. 
stepped color filter wheel shown at 97, the output of No. 5,138,454 entitled "Megapixel Video Previewer 
inage sensor 60 is digitized and stored in an associated Framestore and Display", by K. A. Parulski et al, as- 
image framestore of host processor/microcontroller 38. signed to the assignee of the present application and the 
The stored digitized image is then processed by the host 60 disclosure of which is herein incorporated. As de- 
image processor for storage on a digital storage me- scribed in that application, the auxiliary preview fra- 
dium, such as a compact disc, which may then be deliv- mestore apparatus includes a pair of 'ping-pong' write/- 
ercd to the customer for playback by a CD player and read memories* the pixel and line rate clocks to the 
display on a home television set. address generators of which are multiplexed, so as to 

Specifically, a multicolor filter wheel 97 is controlla- 65 not only permit rapid display of a low resolution ver- 
bly rotated by a motor controller 99 to sequentially sionofthe photoprint image, but to display the image in 
insert a respective one of successive red, green and blue a variety of formats for optimizing the manner in which 
filters in the path of the projected image, while the the photoprint may be digitized and stored. 
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Referring now to FIG. 8, a diagrammatic illustration reference to FIGS. 9-14, which show flow among the 
of a user interface mounted on a control panel of the respective modes of operation of the system, all of 
scanner and employed by the phoiofmisher to adjust which may be invoked manually by the operator and 
photoprint image magnification and focus is shown as some of which are invocable automatically in accor- 
comprising a set of control buttons 70. Control buttons 5 dance with photoprint image parameter information 
70 are coupled to microcontroller 38 via an input inter- contained on one or more machine readable regions on 
face to supply user requests which are serviced as inter- a platen. 

mpts for controlling the operation of the system. As pccpr a NTH ct FPP MOTIF* fFin Q\ 

shown in FIG. 8, the control buttons include four mode RESET AND SLEEP MODES (FIG. 9) 

buttons 111, 121, 131, 141, respectively denoted 10 As shown in FIG. 9, which depicts both RESET 
FRAME, FOCUS, CAPTURE and PROGRAM, MODE and SLEEP MODE routines, upon system 
through which respective modes of operation of the power up or reset, a first STEP 151 is performed, 
scanner are initiated. whereby various components of the scanner assume 

Associated with the FRAME mode button 111 is a prescribed home or reset conditions, including the 
zoom- in button 112, a zoom-out button 114, a set of size 15 placement of filter wheel 97 to a 'green 1 position that 
buttons 113, 115, 117, respectively associated with pre- inserts the green filter into the projected image path, 
scribed photoprint sizes — 3R, 4R and 5R. When the and the movement of the dither mechanism to a first of 
zoom-in button is depressed during FRAME mode, its four possible orientations, denoted dither position 1. 
zoom lens 54 is stepwise displaced to increase the mag- The routine then proceeds to FRAME MODE, shown 
nification of the image projected on image sensor 60 and 20 in FIG. 10. 

displayed on 4 pr cv * cw * monitor 40. Conversely, when Also shown in FIG. 9 is a SLEEP MODE, which is 
the zoom-out button is depressed during FRAME used to inhibit the generation of pulse signals for sensor 
mode, zoom lens 54 is stepwise displaced to decreased operation. If a prescribed period of time elapses without 
the magnification of the image. When any of the size the operator pushing one of the buttons on the control 
buttons 113, 115, 117 is depressed during FRAME 25 panel> this mode is invoked and the FRAME, FOCUS 
mode, zoom lens 54 is displaced in accordance with a AND CAPTURE buttons are illuminated; in addition 
default magnification value for the corresponding pho- the shutter is placed in its closed position, as shown in 
toprint size. STEP 153. The system remains in the SLEEP mode 

Associated with the FOCUS mode button 121 are a until one of the buttons is pushed («= I), whereupon the 
focus-in button 122 and a focus-out button 124. When 30 routine proceeds to the mode associated with that but- 
the focus-in button 122 is depressed during FOCUS ton. 

mode, the focus ring of zoom lens 54 is stepwise dis- c w Anc m ~ - m 

placed in a first direction. Conversely, when the focus- FRAMfc MODE (FIG. 10) 

out button 124 is depressed during FOCUS FRAME FIG. 10 shows the operational flow through the 

mode, the focus ring of zoom lens 54 is stepwise dis- 35 FRAME mode, which is the basic routine through 

placed in a second, opposite direction. which the scanner operator adjusts the zoom lens to 

When the C aPTURE mode is invoked by depressing optimize the photoprint image for capture and digitized 
button 131, filter wheel motor 97 and shutter 101 are storage. When this mode is invoked, as upon system 
operated so as to capture a color high resolution image power up (POWER =1), or by pushing the frame but- 
projected onto photosensor 60. When the PROGRAM 40 ton 111 when the system is in SLEEP mode, a light 
mode button 141 is depressed, current settings for the through w hich vertical button 145 is illuminated is 
focus and zoom rings of zoom lens 54 are stored as turned off (STEP 161) and a software timer associated 
default values for a selected one of size buttons 113, 115, with invoking the SLEEP mode is reset (STEP 163). In 
117. STEP 165 the FRAME button is illuminated and the 

Also shown in FIG. 8 is a VERTICAL button 145. 45 preview display is set to a low resolution frame mode 
Depressing this button provides an indication to the for viewing a monochromatic (green filter inserted) 
microcontroller that the image on the photoprint has a photoprint image. The routine then proceeds to deter- 
vertical, rather than a conventional horizontal, orienta- mine which, if any of the buttons on the control panel 
tion. This indication is used by the downstream CD has been pushed. 

recording system to store, as pan of an image control 50 Typically the photofinisher will initially push one of 
file on the disc* a code representarive of the fact that the the size buttons 113, 115, 117 which causes zoom lens 54 
image has a vertical orientation so that on playback it to be rapidly translated to whatever 3R magnification 
will be displayed upright. default value is currently stored in memory, as denoted 

The scanner's user interface also includes an on/off by respective STEPs 171, 173 175. When the zoom lens 
switch, or POWER button 143, a HI RES button 146 55 has been moved to the selected default magnification 
used to select whether or not the image is to be captured position, the softimer is reset (STEP 179) and the rou- 
as a high resolution (HI RE5= 1) or a low resolution tine proceeds again to STEP 167. 
(HI RES— 0) image, and a RESET button 147, which For purposes of the present description it will be 
resets the system. (RESET = 1 ). assumed that the image on the preview display requires 

As described above, control buttons 70 are employed 60 magnification adjustment. In this case, the scanner opcr- 
by the system operator (photofinisher) to supply user ator pushes zoom-in, zoom-out buttons 112, 114, as 
requests which are serviced as interrupts for controlling necessary, to cause zoom lens stepper motor 84 to incre- 
the operation of the system. The application program mentally adjust the position of zoom lens 54 (STEPS 
employed by microcontroller 38 to initiate service for 181, 183). Thus, through the operation of the size and 
any pushbutton request contains a module or interrupt 65 zoom adjust buttons, the operator controls the degree of 
service routine denoted as hsio_isr(). In the description magnification of the projected and displayed image, 
to follow, the sequence of operations carried out by this Whenever the setting of the zoom lens is changed, an 
embedded control mechanism will be described with adjustment of the focus ring is required in order to 
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maintain the image in focus on image sensor 60. The speed values associated with the respective filter colors, 
focus adjustment required is an approximately linear are employed. Shutter speed is also dependent upon the 
function of the zoom lens setting and may be derived magnification setting of the zoom lens. To accommo- 
empirically. FIG. 13 shows such an empirically deter- date these dependency variations a shutter speed look- 
mined characteristic 130, which is preferably stored in a 5 up table, such as shown in FIG. 13, may be empirically 
focus adjustment look-up table and is used by raicrocon- developed and stored in memory. Then during image 
troller 3$ to adjust the focus of the zoom lens as its capture, the shutter speed for a particular filter wheel 
magnification setting is changed. color is modified in accordance with the look-up table 

If the image on the photoprint was captured with the value for the magnification setting of the zoom lens, 
camera rotated 90 degrees (vertically oriented), the 10 

operator pushes VERTICAL button 145, causing that PROGRAM MODE (FIG. 14) 

button to be illuminated (STEP 135), so that microcon- As pointed out previously, a particularly useful fea- 
troller will store a code representative of the fact thai turc of the present invention is its default setting adjust* 
the image has a vertical orientation, to ensure correct ability, which significantly reduces the workload on the 
orientation on playback, as explained previously. 15 photofinisher by obviating his need to perform a zoom 
FOCUS MODE (FIG. 11) lcns adjustment ftw each photoprint of a given batch of 

photoprints. Adjusting the default setting of the zoom 
To control the focus, the scanner operator pushes the i ens ^ rca dily accomplished by means of PROGRAM 
FOCUS button Hl(FOCUS=l), causing the FOCUS ^Xlon U1 which ^fatts ^ PROGRAM routine 
mode routine of FIG. 11 to be invoked. Again, the 20 s^wn in FIG 14 

software timer is reset (STEP 191), the J^PCUS button When the scanner operator (photofinisher) pushes the 
121 is illuminated (STEP 192) and STEP 193 causes a PROGRAM button 141 (PROGRAM— 1), in either the 1 
control signal to be coupled to the above-referenced FOCUS mode or the mod ^ software 

auxiliary preview framestore apparatus. Tins control ^ * r^t (STEP 241). The routine then proceeds to 
signal * used to modify the frame store read out opera- 25 m tQ check which of thc sirc btttto ; s 113 , 115f 
tion so that only a prescribed region (a center portion) becR pashed , mdica ting for which phot0 print 

of the preview display to be updated as the focus is si ^ thec ^ ldcfa ri t values for the magrufication and 

A?* the FRAME mode, in STEP 195. the FOCUS S^SHLn^^ fZflt 
mode routine determines which of focus-in or focus-out 30 2S flSs!fffr^S?M 2 ttaseva? 
buttons 122, 124 has been pushed. In response to what- » °ne of STEPS 243, 244 245, by those val- 

ever of these buttons is pushed by the T photofinisher ««wmch represent the posmons of the z^ and f^us 
(STEPS 201, 203), focussing ring 65 will be stepwise ™ * s * b * &e Photofmisher by operation of 

adjusted each time the button is depressed. After focus the zc«m^ zoom-out, focused focus-out buttons, 
adjustment, the routine proceeds to reset the software 35 « J csc ^ ed f f FRAME and FOCUS 

timer (STEP 205) and returns to STEP 195. »d» D f w dcfault^ues have been stored 

the routine proceeds to the FRAME mode. (For each 
CAPTURE MODE (FIG. 12) of thc FRAME, FOCUS, and PROGRAM modes, if no 

Next, it will be assumed that the scanner operator le " s adjustment button or size button is pressed by the 
pushes the CAPTURE button 131 (CAPTURE = I), so 40 scaimCT operator within the period of the prescribed 
that the operation proceeds to the CAPTURE mode «™ out * thc TIMEOUT bit will be set to a value of 
routine shown in FIG. 12. In the initial STEP 211, the m * w * thereby invoking the SLEEP mode, described 
CAPTURE mode button 131 is illuminated and a con- previously. 

trol signal is coupled to the auxiliary preview frames- ^ adjustment of the image projection optics may 
tore apparatus, to place the preview display in the frame 45 carried out for photoprints positioned at either the 
mode, described previously. When the HIGH RESO- *PP e * imaging station or the platen feed station, its 
LUTION button 146 has been depressed (HI RES^l), principal benefit is obtained for platen-mounted photo- 
the image capture routine stepwise rotates the dither P™ts which are fed to the platen feed station, where 
plate through all four positions for each of the green, «nag« parameter data codes on the platens are read by 
red and blue color components, as shown in STEPS 221, 50 *e microcontroller for automatic magnification con- 
222 and 223, so as to image three successive high resolu- trol. Where the photoprint is placed in a face-down 
tion images of the photoprint, each of a respectively condition on top plate 21, the translatable unit 13 is 
different color, on sensor 60. For low resolution image positioned as necessary to locate upper imaging station 
capture (the HIGH RESOLUTION button 146 has not 15 such that the photoprint is transported to an opti- 
been depressed (HI RES=0)), the dither plate is not 55 mum viewing position, as displayed by 'preview* dis- 
stepped through its four positions. Instead, the filter play 40. The operator then controls the image magnifi- 
wheel is rotated through each of the green, red and blue cation/focussing unit 52 until the displayed image of the 
color components, as shown in STEPs 231, 232 and 233, photoprint is satisfactory. The image is then scanned by 
so as to image three successive low resolution images of scanning unit 60, and thc resulting digitized high resolu- 
the photoprint, each of*a respectively different color, on 60 tion color image of the photoprint is stored in an atten- 
sensor 60. Upon completion of image capture, either of dant framestore. 

Steps 223 or 233, the routine proceeds to FRAME On the other hand, platen imaging station 17 is used 
mode (FIG. 10). to automatically digitize a plurality of photoprints that 

Depending upon which color filter is placed in the are mounted to respective ones of a stack of platens fed 
path of the projected image by the stepwise operation of 65 in sequence from a supply magazine 32. As each platen 
color wheel 97, the amount of light incident on the is fed to the platen imaging station, the image parameter 
sensor array will vary, so that the shutter speed must be data, such as photoprint size (e.g. 3R, 4R, 5R), con- 
varied accordingly. For this purpose, preset shutter tained in machine readable regions on the platens is 
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detected by one or more image parameter sensors and 3. A method according to claim 2, wherein step (c) 

coupled to microcontroller 38. comprises adjusting the magnification of said image by 

On the basis of this image parameter data, microcon- said image projection apparatus, 

trailer 38 controls adjustable image magnification unit *. A method according to claim 3, wherein step (c) 

54, so as to adjust the size and focus of the image in 5 includes adjusting the focus of said image on said image 

accordance on the photoprint that is projected onto receiving region. 

image sensor 60. The photoprint image that is focussed 5. A method according to claim 3, wherein step (c) 

on the image sensor is, in turn, coupled to the 'preview' comprises adjusting, as necessary, the focus of said 

display 40. As explained above, by observing the 'pre- image with the adjusting of the magnification of said 

view* display, the photofinisher adjusts as necessary the *° image, so as to maintain the projected image in focus on 

control parameters of the image magnification/focuss- image receiving region. 

ing unit, until the previewed image is focussed and ^ A method according to claim 3, wherein step (b) 

correctly geometrically positioned on the display comprises causing said image projection apparatus to 

screen. Any adjustment of these control parameters is project an image onto said image receiving region in 

stored in the default look-up table, so that the control 15 accordance with a selected one of said magnification 

parameters for the image magnification/focussing unit default values. 

axe now effectively calibrated to a particular sized pm> . r A method according to claim 6, wherein step (c) 

toprint. Thereafter, for subsequently fed platen- includes adjusting the focus of the image projected on 

mounted photoprints of that size, the operation of the ™ «cewiag region. 

image niagnification/focussing unit projection device is 20 * A method according to claim 6, wherein step (c) 

automatically referenced to the newly calibrated pa- comprises adjustmg, as necessary, the focus of said 

rameter settings, thereby facilitating rapid scanning of a l™** ^ thc ol the magnification i of said 

series of platen-mounted photoprints. ^ 50 * to ?? ntain <?* Projected image in focus on 

As will be appreciated from the foregoing descrip- receiving region, 
tion, the need for a photofinisher to perfonn a zoom lens 25 * A method according to chum 1. wherein said pro- 
adjustment of a digitizing scanner for each photoprint *PP™** forth* includes an image capture 
of a given batch of photoprints is obviated by a lens d ™*^t%£ *f TF M °? mg 
contrS mechanism through which default settings for * u T*l 
xoomlensmagn^ 30 mTh^^^ ^ 

jj- • 1 t_ * ■ * e *t r x onto 511(1 miage receiving region, 

ter as additional photopnnts of the same size of that lfJ A mcthod ^ to^laim 9, wherein step (e) 

batch are processed, the reprogrammed default settings comprises 

are used without the need for adjustment, so that each 35 {et) causirig ^ imagc projection apparatus to 

photoprint will be properly imaged on the scanners project — ^ onto ^ ^ receiving ^ 0n 

p „ / ?!f nsor - , , , » - , . in accordance with the operational control values 

While we have shown and described several embodi- stored in step (d) and 

meats in accordance with the present invention, it is to (e2) causing ^ ^ ^Kire device to capture the 

be understood that the same is not limited thereto but is 40 projected onto said image receiving device 

susceptible to numerous changes and modifications as ^ ^ ^ e j^ 

known to a person skilled in the art, and we therefore U . A method according to claim 2, wherein said 

do not wish to be limited to the details shown and de- ima g e projection apparatus includes a zoom lens device 

scribed herein but intend to cover all such changes and through which the magnification of said image on said 

modifications as are obvious to one of ordinary skill in 45 receiving region is adjustable and wherein step 

a*** (c) comprises adjusting said zoom lens device so as to 

What is claimed: adpst the magnification of said image on said image 

1. A method of controlling the operation of an image receiving region. 

projection apparatus which is operative to project an tf. A method according to claim 11, wherein the 

image onto an image receiving region, in which a pre- 50 focus of said zoom lens device is adjustable, and 

scribed attribute of said image is adjustable to a plurality wherein step (c) comprises adjusting, as necessary, the 

of attribute settings, comprising the steps of: focus of said zoom lens device with the adjustment of 

(a) storing respective default values for respective th e magnification of said image provided thereby, so as 
ones of said plurality of attribute settings; to maintain the projected image in focus on said image 

(b) causing said image projection apparatus to project 55 receiving region. 

an imagc onto said image receiving region; 13. A method according to claim 12, wherein the 

(c) adjusting at least one operational parameter of plurality of default magnification settings of said zoom 
said image projection apparatus and thereby caus- lens include settings respectively associated with 3R, 
ing said image projection apparatus to adjust at 4R and 5R photoprint image sizes. 

least one characteristic of the imagc projected on 60 14. A method according to claim 11, wherein said 

said image receiving region in step (b); and projection apparatus further includes an image capture 

(d) storing operational control values employed by device coupled with said image receiving region and 
said image projection apparatus to project thc controllably operative to capture an image projected 
image adjusted by step (c) as default values For a onto said image receiving region, and wherein said 
selected one of said plurality of attribute settings. 65 method further includes the step of (e) causing said 

2. A method according to claim 1, wherein said pre- image capture device to capture an image projected 
scribed attribute corresponds to the magnification of onto said image receiving region by said zoom lens 
said image on said image receiving region. device. 
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15. A method according to claim 14, wherein step (e) 
comprises (el) setting the magnification and focus pa- 
rameters of the zoom lens device in accordance with 
default values stored in step (d), and (c2) causing said 
image capture device to capture the image projected 
onto said image receiving region by said zoom lens 
device. 

16. A method according to claim 15, wherein said 
image capture device includes an image sensor and an 
image storage device coupled thereto, wherein step (e2) 
includes controllably varying the spatial location at 
which an image projected by said zoom lens device is 
incident upon said image sensor and, for each location, 
storing the incident image in said image storage device. 

17. A method according to claim 16, wherein step 
(e2) comprises storing a selected color component of 
the projected image and wherein step (e2) is repeated 
for successively different color components of said 



10 r 



15 



18. A method according to claim 17, wherein said 
apparatus includes a color filter mechanism containing a 
plurality of respectively different color filters that are 
sequentially insertable in the path of said projected 
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d) storing information representative of the adjust- 
ment of the operation of said image projection 
device in step (c); and 

e) for subsequent presentations of photographic re- 
cording media to said apparatus in accordance with 
step (a), causing said image projection device to 
project an image in step (b) in accordance with the 
adjustment information stored in step (d). 

22. A method according to claim 21, wherein said 
image projection device comprises an adjustable lens 
device, and wherein step (c) includes adjusting the op- 
eration of said adjustable lens device so that the image 
displayed by said image display device is displayed in 
focus on said display device. 

23. A method according to claim 21, wherein said 
image projection device comprises an adjustable focus 
zoom lens device and wherein step (c) includes adjust- 
ing the focus and magnification of said zoom lens device 
so that the displayed image is displayed in focus and 
substantially fills the display area of said display device. 

24. An apparatus for controlling the projection of an 
image that has been recorded on a photographic record- 
ing medium onto a photoresponsive device, said photo- 



image, and wherein step <e2) is repeated in association 2 5 I pP onsivc device providing output signals representa. 
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with the insertion of successive ones of said respectively 
different color filters in the path of said projected im- 
age. 

19. A method according to claim 18, wherein step 
(e2) is carried out for respective red, green and blue 30 
color components of said image. 

20. A method according to claim 9, wherein step (e) 
includes the step of storing information representative 
of the orientation of said image on said image receiving 
region. 

21. For use with an apparatus for digitizing an image 
that has been recorded on a photographic recording 
medium and storing the digitized image on a digital 
storage medium, said apparatus including an image 
projection device and a photo-responsive device upon 40 
which an image on said photographic recording me- 
dium is projected by said image projection device, said 
photo-responsive device providing output signals repre- 
sentative of the image projected thereon, said output 
signals being digitized for storage on said digital storage 45 
medium, said apparatus further including a display de- 
vice to which output signals provided by said photo- 
responsive device are coupled so as to display the pro- 
jected image, a method of controlling the operation of 
said image projection device so as to control the manner 

in which an image on said photographic recording me- 
dium is projected upon said photo-responsive device 
comprising the steps of: 

a) in the course of presenting a photographic record- 
ing medium to said apparatus for digitizing the 
image thereon, providing an indication of the size 
of the image; 

b) causing said image projection device to project an 
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ta've of the image projected thereon, said output signals 
being coupled to a display device so as to display the 
projected image, said apparatus comprising: 
a controllable magnification, image projection device 
which is operative to controllably project an image 
on said photographic recording medium onto said 
photoresponsive device; 
a projection device controller which is operative to 
control the operation of said image projection de- 
vice so as to cause said image projection device to 
project an image on said photographic recording 
medium onto said photo-responsive device in ac- 
cordance with information representative of the 
size of said image as recorded on said photographic 
recording medium, said projection device control- 
ler being operative to adjust, as necessary, the op- 
eration of said image projection device so that the 
image displayed by said image display device has a 
prescribed size; 
a storage device which is controllably operative to 
store information representative of the adjustment 
of the operation of said image projection device; 
and wherein 

said projection device controller is coupled to said 
storage device to access therefrom, for subsequent 
presentations of photographic recording media to 
said apparatus, adjustment information stored in 
said storage device, and to control the operation of 
said projection device in accordance with said 
accessed adjustment information. 
25. An apparatus according to claim 24, wherein said 
inage projection device comprises an adjustable focus, 
zoom lens, and wherein said projection device control- 
ler is operative to adjust the operation of said zoom 



image presented in step >fo) upon sud photorespon- & adjustable lens so that the image displayed by said 
J "~~~ "~ - J " L ~ image display device is displayed in focus on said dis- 

play device and substantially fills the display area of said 
display device. 
26. An apparatus according to claim 25, wherein the 



sive device in accordance with the size indication 
provided in step (a); 
c) observing a display of the image projected on said 
photo-responsive device in accordance with step 



(c) and adjusting, as necessary, the operation of 65 output of said photo-responsive device is coupled to an 



said image projection device so that the image 
displayed by said image display device has a pre- 
scribed size; 



image signal digitizing device which is operative to 
convert said output signals into digital format for stor- 
age into a digital image database. 
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27. An apparatus for controlling the operation of an 
image projection device which is operative to project 
an image onto an image receiving region, in which a 
prescribed attribute of said image is adjustable to a plu- 
rality of attribute settings, comprising: a storage device 
which is operative to store respective default values for 
respective ones of said plurality of attribute settings; 

a projection device controller which is operative to 
cause said image projection device to project an 
image onto said image receiving region; 

a control mechanism for adjusting at least one opera- 
tional parameter of said image projection device 
and thereby causing said image projection device 
to adjust at least one characteristic of the image 
projected on said image receiving region; and 

wherein said control mechanism is controllably oper- 
ative to cause said storage device to store opera- 
tional control values employed by said image pro- 
jection device to project the adjusted image as 
default values for a selected one of said plurality of 20 
attribute settings. 

28. An apparatus according to claim 27, wherein said 
prescribed attribute corresponds to the magnification of 
said image on said image receiving region and said pro- 
jection device controller is operative to adjust the mag- 
nification of said image by said image projection device. 

29. An apparatus according to claim 28, wherein said 
projection device controller is operative to adjust the 
focus of said image, so as to maintain the projected 
image in focus on said image receiving region. 

30. An apparatus according to claim 28, wherein said 
projection device controller is operative to cause said 
image projection device to project an image onto said 
image receiving region in accordance with a selected 
one of a plurality of magnification default values. 

31. An apparatus according to claim 27, further in- 
cluding an image capture device coupled with said 
image receiving region and controllably operative to 
capture an image projected onto said image receiving 
region. 

32. An apparatus according to claim 31, wherein said 
controller is operative to cause said image projection 



receiving region is adjustable and wherein said control- 
ler is operative to adjust said zoom lens so as to adjust 
the magnification of said image on said image receiving 
region. 

5 34. An apparatus according to claim 33, wherein the 
focus of said zoom lens is adjustable, and wherein said a 
controller is operative to adjust, as necessary, the focus 
of said zoom lens with the adjustment of the magnifica- 
tion of said image provided thereby, so as to maintain 
10 the projected image in focus on said image receiving 
region. 

35. An apparatus according to claim 34, wherein the 
plurality of default magnification settings of said zoom 
lens include settings respectively associated with 3R, 
4R and 5R photoprint image sizes. 

36. An apparatus method according to claim 32, fur- 
ther including an image capture device coupled with 
said image receiving region and which is controllably 
operative to capture an image projected onto said image 
receiving region, and wherein said controller is opera- 
tive to cause said image capture device to capture an 
image projected on o said image receiving region by 
said zoom lens, and wherein said controller is operative 

25 to set magnification and focus parameters of the zoom 
lens in accordance with default values stored in said 
storage device. 

37. An apparatus according to claim 36, wherein said 
image capture device includes an image sensor and an 

30 image storage device coupled thereto, and further in- 
cluding a dither device which controllably varies the 
spatial location at which an image projected by said 
zoom lens device is incident upon said image sensor, 
and wherein said controller is operative to cause said 
35 image storage device to store, for each location, the 
incident image. 

38. An apparatus according to claim 37, further in- 
cluding a color filter mechanism containing a plurality 
of respectively different color filters that are sequen- 

40 tially insertable in the path of said projected image, and 
wherein said controller is operative to cause the inser- 
tion of successive ones of said respectively different 



device to project said image onto said image receiving color filters in the path of said projected image and to 
region in accordance with the operational control val- cause said image storage device to store successively 
ues stored in said storage device and to cause said image 45 selected color components of the projected image. 



capture device to capture the image projected onto said 
image receiving device. 

33. An apparatus according to claim 28, wherein said 
image projection device includes a zoom lens through 
which the magnification of said image on said image 50 



39. An apparatus according to claim 27, 
wherein said control mechanism includes means for 
storing information representative of the orienta- 
tion of said image on said image receiving region. 
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ABSTRACT 



A number of light measuring elements are arranged at 
various portions of an image of an object focused by an 
objective. The light measuring elements are grouped for 
different zones to measure the average brightness of the 
image within the respective zones. The average bright- 
ness of the image is weighed and added together to 
calculate the brightness of the object based on which 
the exposure is controlled 
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(Ki, Ki+\ are coefficients.), and controlling the expo- 
EXPOSURE CONTROL METHOD AND DEVICE sure based on the object brightness B. 

The average brightness Bmi is obtained by dividing 
BACKGROUND OF THE INVENTION the sura of the log-converted valoe of the measured 

1 . Field of the Invention 5 brightness by the number of light measuring elements in 
The present invention relates to an exposure control tnc 20nc > or b y owning the average of the brightness 

method and a device therefor for use in a photographic measured by the light measuring elements in the respec- 
camera, a motion picture camera, a television camera or t,ve 201165 and log-converting the sum Therefore, there 
the like, and more particularly to a method of control- ln is no fear mat tne brightness is effected by the high 
ling exposure for such an optical instrument in which brightness portion of the object as experienced in the 
the exposure is controlled based on the brightness of a conventional central spot light measuring system, 
focused image of the object to be photographed and an The present invention is advantageous in that the 
exposure control device for carrying out the method/ most desirable complex zone pattern can easily be se- 

2. Description of the Prior Art 15 lcctcd fo * * e given toner the average 
There have been known an average light measuring brightness of the respective zones can be properly 

system in which one or two light measuring elements weighted by use of proper weighting coefficients, and 
are used for measuring the brightness of the image of an accordingly the exposure control can be conducted 
object as a whole and a centra! spot light measuring more properly than any conventional method, 
system in which the central portion of the image is 20 Thc P rcsent invention is further advantageous in that 
particularly measured. Further, recently it has been the zone pattern can be changed for different scene of 
known to use a number of light measuring elements to the object For instance, in case of a spot light iUumi- 
measure the various portions of the image and detect nated object, the image area is divided into concentric 
• he maximum and minimum brightness of the image to zones distributed around the center of the image, and in 
control exposure based on the maximum or minimum 25 case of an object in back light the area is divided, into 
brightness or average brightness calculated therefronv zones distributed concentrically, around a point a little 

The above-mentioned conventional methods of expo- below the center of the image area. . r ■ 

sure control suffer from defects in that the obtained Farther, it is possible to change the weighting coeffr 
exposure becomes under or over depending upon the cients for the respective zones for different scenes of the 
specific brightness distribution of the image as of back- 30 object For instance, in case of a spot light illuminated 
tight image or scene having- a dark background. object, the central zones are provided with larger 

qiimmaby fWTHF TNVPNmnN weighting coefficients, and in case of a back light object 

SUMMARY OF THE INVENTION the margina] zones are provided with smaller coeffiri- 

The object of the present invention is, therefore, to cnts. 
provide a method of controlling exposure in which 35 Furthermore, it is possible to obtain a whole average 
proper exposure can be obtained even when the image brightness (Bo) averaged throughout the whole image 
has uneven distribution of brightness. and use the same for correcting the exposure by adding 

Another object of the present invention is to provide the same to the above brightness (Bmi) after weighting 
a device for controlling exposure carrying out the the former. 

above method of exposure control 40 h case that the zone pattern is asymmetrical and the 

Still another object : of the present invention is to position thereof changes as the position of the camera 
provide a method of controlling exposure in which changes, the position of the camera is detected to cor- 
proper exposure can be obtained for various kinds of rect the position of the zone pattern so that the zone 
images by changing the light measuring mode depend- pattern may properly be applied to the object image 
ing upon the object 45 even when the camera position ts changed. 

A further object of the present invention is to provide m „ — ™ ... *~r~ 

a method for controlling exposure in which proper BRIEF DESCRIPTION OF THE DRAWING 
exposure can 'be obtained for various positions of the FIG. 1 is a plan view of the light measuring portion 
camera or the like by changing the light measuring used in the present invention, 
mode depending upon the position of the camera. 50 FIGS. 2 to 5 arc side sectional views showing the 

A still further object of the present invention is to various arrangements of the light measuring portion 
provide ah exposure controlling device for carrying out used in the present invention, 
the above methods in which proper exposure can be FIG. 6 is a partial explanatory view showing an ex- 
Obtained for various kinds of objects and for various J5 ample of an arrangement of the light measuring eje* 
positions of the camera or the like. ments connected with lead lines, 

The above objects of the invention are accomplished pjos. 7A to 7H are front views showing various 
by dividing the light measuring range of an image of an examples of the zone pattern, 

object into a number of zones, arranging at least one FIG. 8 is a circuit view snowing an embodiment of 
light measuring elements in the respective zones, ob : w tne exposure control device in accordance with the 
taining the average brightness of the image in the re- present invention, 

spective zones (Bmi), calculating the object brightness FIG. 9 is a circuit view showing an example of a 
B based on the average brightnesses Bmi by the for- variation of the circuit in which the output of photodi- 
°iula: odes is amplified before connected to the control cir- 

65 cuit, 

B *= K 4- £ K Bmi (I) FIG ' *® * 2 b ' 0C * t diagram showing another embodi- 

1 . fssj (/+ 1> ' ml ment of the exposure control device in accordance with 

the present invention, 
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FIGS. 11 A, to 11C are front views showing the rela- 
tionship between the position of the camera and the 
way of dividing the image area into zones, 

FIG. 12 is a block diagram showing an exposure 
control device which Is able to change the way of dividt 5 
ing the area into zones according to the position of the 
camera, 

FIG. 13 is a front view, showing an example of a 
camera position detecting means, i , 

FIGS. 14A to 14C are front views showing another 10 
example of the way of dividing the area into zones, 

FIG. 15 is a block diagram showing an embodiment 
of the exposure control device of this invention in 
which the way of dividing the area into zones can be 
changed by means of a switching circuit, "15 

FIG. 16 is a block diagram showing an embodiment 
of a digital type exposure control device, and /. 

FIG. 17 is a flow chart which shows the process of 
data input employed in the present invention. 

. DESCRIPTION OF THE PREFERRED. < 20 
; i .EMBODIMENTS t. 

Now the present invention will Be described m detail 
with reference to the accompanying drawings. 

Referring to FIG. 1 showing' the light measuring 25 
portion employed in the present invention, a number of 
light measuring elements 2a to 2n are provided' on 'a 
base board 1 in the form of a matrix; The light measur- 
ing elements 2a to lit may- be in the form of photodi- 
odes, photovoltaic elements, phototranststors, CdS, 30 
photo-charge- storing type CCD (charge coupled de- 
vice) and the like. Since .the CCD has a narrow -dynamic 
range,, it is. desirable- that the storing time be changed 
according to the brightness of the object to control 
sensitivity. • •. * 35 

FIGS. 2 to 5 show various examples of the light mea- 
suring, portion. FIG. 2 shows an example in. which the 
light measurement is conducted in parallel to the photo- 
graphing system. In this example, an objective 3 is lo? 
cated in front of a light measuring portion. 5 with the 40 
intervention of a stop 4 located therebetween. A taking 
lens 6 is provided separately therefrom .in parallel 
thereto to focus an image on a .photographic film 9 
through a stop 7. Thus,, the light measuring portion 5 
measures the light from the object (not shown) to be 45 
photographed by the camera with the taking lens 6. 

FIG. 3 shows another example in which a light mea- 
suring portion Sa is provided in a view finder. An objec- 
tive 9 is provided in front of an eyepiece 11. with the 
intervention of a semi-transparent mirror 10 located 50 
therebetween. The semi-transparent mirror 10 reflectes 
a part of the light coming in through the objective 9 
toward the light measuring portion 5a 

FIG. 4 shows anothep example in which a light mea- 
suring portion Sb is provided in a single lens reflex 55 
camera. A part of the swing-up mirror 14 is made trans- 
parent to transmit the light coming in from the taking 
lens 16. A concave mirror 15 is located behind the mir- 
ror 14 to reflect the light transmitting through the mir- 
ror 14 downward toward the light measuring portion 60 
Sb. A stop 17 is located behind the taking lens 16. Thus, 
a part of the light coming in through the taking lens 16 
is focused on the light measuring portion 5* and forms 
a small image of the object to be photographed thereon. 

FIG. 5 shows still another example in which light 65 
measuring portions 5c Sd and 5e are located in the 
vicinity of a pentagonal prism 18 of a single lens reflex 
camera as shown in FIG. 4. The mirror 14 reflects the 
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light coming in from the taking lens 16 upward. The 
light reflected upward by 'the mirror 14 enters a pentag- 
onal prism 18 through a focusing glass 19 and a con- 
denser lens 20. The light measuring portion 5c is located 
above the prism 18, Sd in front, thereof and 5e therebe* 
hind. In front of the respective light .measuring portions 
5c, Sd and Se are located focusing lenses 21c, ltd and 
21c; respectively. ... 

The light measuring' portion 5 as mentioned herein- 
above is provided with a number of light measuring 
elements 2a, _ lb. . . . 2/ connected by means of lead wires 
22 and 23 according to. the group of the elements di- 
vided in zones. In the example shown in FIG. 6, ele- 
ments 2a\ 2b and 2d are connected together and ele- 
ments 2c, 2e and 2/ are connected together. Hie former 
three make one zone and are grouped together and the 
latter three make another zone and are grouped to- 
gether. -By dividing thelight measuring elements 2a 2b, 
. . .'fight photodiodes into two groups, it b possible to 
divide the image area into two zones as illustrated in 
FIGS. 7A to 7C. Furtheri by dividing the area into 
more zones, the area can be divided as shown in FIGS. 
7£>to 7H, for exa nple. In the example as shown in FIG. 
7H,'the image aiea or the light measuring jtortion is 
divided into three ?ones, i.e. ; one being illustrated as 
blank zone,' another as hatched zone and the other as 
cross-hatched zone each zone consisting of a plurality 
of elements. 

* Since the brightness of thernarginal portion of the 
image is low due to the optical performance of the 
objective or the taking lens, the output of the light 
measuring elements located in the marginal region of 
the focused image is low. Therefore, it is desirable that 
the light receiving area of the light measuring elements 
located in the marginal portion or the area of the zone 
in. the marginal portion be made larger than that of the 
central portion. - ' . 

The zone pattern as shown in FIG. 7B : or 7D is, sym- 
metric both vertical and horizontally. Therefore, the 
pattern does not change with the position of the camera. 
The zone pattern as shown in FIG. 7D is used with the 
weighting coefficients, as follows for example, where 
the coefficients Ki correspond to those shown in for- 
mula (1): 

Ki = 1 .43, K2=0.53 (coefficient of zone Z|), . 
. K 3 =0.12 (of zone Z 2 ), *U=-0.08 (of zone Z 3 ), 
K5=0.34(ofzoneZ4). 

The exposure control method and device in accor- 
dance with . the present .invention employs the, light 
measuring portion .5, $a, 5b . '. . as shown above in FIGS. 
7A to 7H located at the position as shown in FIGS. 2 to 
5, for example. Now the exposure control circuit con- 
nected with the light measuring portion employed, in 
the present invention will be described in detail with 
reference to FIG. 8. 

FIG. 8 shows an example of the exposure control 
circuit employed in the present invention. The photodi- 
odes 2a, 2b, . . . 2« as shown in FIG. 6 grouped for the 
zones are connected respectively to operational amplifi- 
ers 25a, 256, . . . 25n The operational amplifiers 25a, . . 
. 25/? are provided with resistors 26a . . . 26a and feed- 
back resistors 27a . . . 27n for controlling the gain 
thereof. The gain is controlled to provide a weighting 
coefficient for the averaged value of the outputs of the 
light measuring elements in the zone. 

The weighted output signals of the zones weighted 
by the operational amplifiers 25a . . . 2Sn and the output 
signal from a potentiometer 28 for providing the con- 
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stant value Ki of the formula (I) are inputed into an FIG. 1IA shows the rone pattern in which the camera 
operational amplifier 29 and log-convened by a log- is held horizontally, namely in its normal position. FIG. 
diode 30 and summed up. In this embodiment the aver- 11B shows the zone pattern in which the camera is held 
aged values are all summed up. However, it is possible with its left side up. FIG. 11C shows the zone pattern in 
to subtract one output signal of a light measuring zone 5 which the camera is held with its right side up. The light 
from the sum of the output signals of the other light measuring elements are numbered 1 to 25. In the posi- 
measuring zones. For example, when the image includes tion of FIG. 11 A, elements 12, 13, 14, 17, 18, 19, 22, 23 
a bright sky, it is possible to subtract the output of the and 24 are grouped into one zone and the others are 
zone corresponding to the sky from the sum of the grouped into the other zone. In FIG. 11B, 
outputs of the other zones. 10 8,9,10,13,14,15,18,19 and 20 are grouped into one zone 

The output of the operational amplifier 29 is sent to and the remainder into the other, and in FIG. 11C, 
an exposure computing circuit 31 as the object bright- 6,7,8,11,12,13,16,17 and 18 are grouped into one zone 
ness information, where a photographic calculation is and the remainder into the other, 
conducted together with a film sensitivity and the like FIG. 12 shows an embodiment of the exposure con- 
front an exposure information input means 32. The out- IS trol device in accordance with the present invention in 
put of the exposure computing circuit 31 controls the which the light measuring portion as shown in FIGS, 
shutter control circuit 33 or the aperture control circuit 11A to 11C having two zones asymmetrically divided is 
34 connected thereto. In the above embodiment as used. The output of the light measuring portion 5 is first 
shown in FIG. 8, the photodiodes 2a in the same group log-converted by a log-conversion circuit 40 and then 
are connected in parallel directly with lead wires. How- 20 inputed into a matrix circuit 44. The matrix circuit 44 
ever, the photodiodes may be connected after amplified makes three groups each consisting of two grpups for 
by amplifiers. the three different positions. 

FIG. 9 shows one of such examples in which the In more detail, in case of FIG. 11 A in which the 
photodiodes 2a \ . . . 2a n are respectively connected with camera is held horizontally, the lower central nine ele- 
operational amplifiers 36a ... 36n and the output of the 25 ments grouped into one zone and the remainder are 
photodiodes are amplified thereby. At the same time, connected to two adding circuits 45a and 456, respec- 
the photodiodes 2a i . . . 2a n are connected with log- tively. In case of FIG. 11B in which the camera is held 
diodes 37a.. .37/1 which are connected in parallel with with left side up, the right central nine elements 
the operational amplifiers 36a .. . 36/l Thus, the output grouped into one zone and the remainder are connected 
of the photodiodes 2aj . . . 2a„ is subjected to log-con- 30 to adding circuits 46a and 466, respectively. Similarly, 
version and impedance conversion. The output signals in case of FIG. HQ the left central nine elements and 
of the operational amplifiers 36a . . . 36n are inputed into the remainder are connected with adding circuits 47a 
an operational amplifier 37 and summed up here. The and 476. respectively. 

resistors 38 and 39 connected before and in parallel to The outputs of these adding circuits 45a,456,46a,46&- 
thc operational amplifier 37 are used for weighting the 35 47a and 476 are inputed into dividing circuits 48a,484- 
averaged value of the output signals. +9a, 496,50a and 506, respectively. The dividing circuits 

FIG. 10 shows another example of the exposure con- divide the summed value by the number of the light 
trol device in accordance with the present invention in measuring elements in each zone, 
which the light measuring portion as shown in FIG, 7D The average brightness is thus obtained for three 
is employed. The light measuring portion 5 is divided 40 kinds of zone pattern for three different positions of the 
into four zones 5t, 52, 5j and 54 which are connected camera. One of the three average brightness outputs is 
with a log-conversion circuit 40. selected according to the position of the camera by 

The log-conversion circuit 40 is constituted of a set of means of an analog switch 51. The analog switch 51 is 
operational amplifiers and log diodes connected in the connected with a camera position detecting means 52 
feed-back circuit thereof for the respective light mea- 45 and one of three sets of switches 5lo,516, 51q5lo; and 
suring elements 2a i . . . 2a„ in the respective light mea- 51e,5tfis turned on according to the detected position 
suring zones. of the camera. When the camera is in the horizontal 

The log-converted signals are inputed into adding position, analog switches 51a and 51a are turned on to 
circuits 41a . . . 41a* provided for the respective zones S\ transmit the output of the dividing circuit 48a and 486 
... 54 and summed up. As the adding circuits 41a ... 50 to a brightness calculating circuit 43. When the camera 
414 adders using operational amplifiers can be used. is held with the left side up, the analog switches 51c and 

The output signals of the adding circuits 41a . . , 41a* 51a* are turned on and when right side up the switches 
are inputed into dividing circuits 42a , . . 42a* and di- 51e and Stf are turned on. The circuit 43 is connected 
vided by a coefficient determined for the area of the with an exposure computing circuit 31. FIG. 13 shows 
zones. By this division, the average brightness Bmi for 55 an example of the camera position detecting means. A 
the respective zones is calculated. Y-shaped glass tube 54 is filled with mercury 55. The 

The average brightness thus obtained is inputed into a mercury 55 moves within the glass tube 54 as the posi- 
weighting adding-and-subtracting circuit 43 and addi- tion of the camera changes. When the camera is held 
tion and subtraction are conducted after being horizontally, the mercury 55 stays in the lower section 
weighted. Thus, the operation of the formula (1) is 60 of the Y-shaped glass tube 54 as shown in FIG. 13 and 
conducted by the circuit 43 to calculate the object electrically closes the switch 56 which corresponds to 
brightness B. The brightness B thus obtained is inputed the first set of analog switches 51a and 516 mentioned 
into the exposure calculating circuit 31. above for instance. When the camera is moved to the 

FIGS. 11 A to 11C show embodiments in which the left side up position in FIG. 13, the mercury 55 moves 
light measuring portion is divided into two zones. Since 65 to the position to close the switch 58. 
the zones are divided into asymmetric pattern with The coefficients Ki for the formula (1) for the other 
respect to the horizontal central line, the position of the examples of the zone pattern may be determined as 
zones change as the position of the camera changes, follows for example. 
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For the example as shown in FIG. 7C in which the Further, in the above described digital circuit, the 

light receiving area is divided into a rectangular section load of the CPU 61 is not so large since the data are 

at the lower center and a U-shaped outer section, the inputed into the CPU 61 after the data are subjected to 

coefficients for the formula (1) may be determined as an analog calculation. Therefore, the capacity of the 

follows: 5 RAM 66 and the processing time can be saved. 

K i = 1 .80, K2 =0, 69 (central), K3 =0.2 1 (outer). FIG. 16 shows another embodiment of the exposure 

For the example as shown in FIGS. 14A to 14C in control circuit. This embodiment is of digital type. The 

which the light receiving area of the light measuring outputs of the light measuring portions are inputed into 

portion is divided into a lower central small section, a log-conversion circuits 70a .. . 70a respectively. The 

middle Oshaped section and an outer U-shaped section, 1° outputs of the log-conversion circuits 70a . . . 70» are 

the coefficients may be determined as follows: inputed into comparators 71c .. . 71», respectively, 

Kt = 1.64, K 2 =0.22 (central), K 3 =0.42 (middle), wmch in turn compare the received outputs from the 

KU=0.27 (outer). log-conversion circuits 70a . . . 70n with a reference 

FIG. 15 shows another embodiment in which the signal from a D/A conversion circuit 72. The outputs of 

zone pattern can be freely changed by selecting connec- 15 * e comparators 71a . . . lln are connected with a multi- 

tion of the photodiodes by use of a switch circuit. Pho- P lexer ™- The multiplexer 73 selects one comparator 

todiodes 2a ... 2a are connected with buffer circuits 60a vnong the number of comparators 7U . . . 71« based on 

. . . 60n respectively, which in turn are connected with the "S*^ 74 from ™ CT ™> m : 

a switch circuit 62 in which selected switches 62a... P^^PU 61 After one of the comparator, e.g. 71* is 

62« included in the same zone designated by a code 20 f*?** b V the multiplexer a set value signal 

signal from a CPU 61 are turned on. By the switch the « vaheto which the output from the 

c£cirit 62 the output signal of the photodiodes in the ^-conversion circuit 70o r as counted up « sent to the 

same zone are inputed into an operational amplifier 63 D/A ^erter 72 and the comparator 71a starts to 

and summed up being log-converted by a log-diode 64. „ ™*f m W ■*"? f ™J 

~- . • . **. , e *L 1 1-^ . 25 D/A conversion circuit 72. The reference signal from 

The output s^ of the operaUonal ampler 63 is comparedwhh the 

^f/S a ^^^ TOnVert ^ 0ad,fi ^ a ^ omputoffelog^nversioncircmt7(teb^ecompar. 

by £ A/D converter 65 ato r 71a When the level of the reference signal reaches 

, TW turning on anothe, -set : of *™tehes 62* . . . 6 2n ^ ^ rf ^ ^ from circuit ^ an^eemeht 

selected.bythedesignauonby the CPU 61 to sum up the 3Q ^ a outputed by ±e comparator 71a Then, the 

outputs of another group of photodiodes 1 included m ^1^1^ 73 outputs the agreement signal 76 whkmm 

another zone, the output representing the brightness of turn ^ inputcd mtQ ^ cpu 61 

the image covering this zone is obtained, ^output fc since the address of the light measuring element in 

similarly A/D converted and recorded in the RAM 66. thc ^ mea suring portion 5 is known from the multi- 

Thus, the data for all the zones are recorded in the 3$ p i exer address signal 74 and the digital value is known 

RAM 66. After all the data are recorded in the RAM from the Mt va i ue signa i 75i when the agreement signal 

66, the brightness information B is finally obtained by 76 is out p U tcd the set value is recorded in the address in 

use of the formula (1). the & corresponding said address of the light 

From the camera side, exposure information repre- measuring elements, 

senting the film sensitivity, aperture size or shutter 40 Then, after the multiplexer address signal 74 is incre- 

specd and the position of the camera is given in the form mented the output signal of the log-conversion circuit 

of an exposure information signal 67 and inputed into 706 nex t to said circuit 70a is similarly recorded in the 

the CPU 61 constituted of a microcomputer or the like. RAM 66. 

A shutter control circuit 68 is connected with the fiq. 17 ghows the above process of recording the 

,CFU 61 and functions as both a timer and a buffer and 45 data in the RAM 66 after A/D conversion thereof, in 

outputs a shutter control signal based on a code signal which the reference characters mean the factors as 

from the CPU 61. follows: 

Further, a ROM 69 is connected with the CPU 61 in 

which are recorded the program for designating the £>M: log-converted output of light measuring elements 

zone and the program for calculating the finally desired 50 DA; set value of D/A converter 

exposure factor based on the exposure information NM: address of light measuring elements 

given by the exposure information signal 67. N: number of light measuring elements 

Further, in the embodiment as shown in FIG. 15, it is DMAX: maximum value set by D/A converter 

possible to change the combination of the photodiodes DN: content of DA. 
2a .... 2n depending upon various conditions. For in- 55 

stance, when the brightness of the object is too low to We claim: 

conduct a proper light measurement due ro insufficient l. A method of controlling exposure based on the 

sensitivity of the light measuring portion 5, the switch brightness of an object measured by light measuring 

circuit 62 is controlled by the order of the ROM 69 to means comprising steps of 

increase the number of photodiodes which constitute 60 arranging a number of light measuring elements in a 

one zone. For example, when 64 photodiodes are used light measuring area for measuring the brightness 

to make 64 picture cells, four photodiodes located adja- of thc object the image of which is focused on said 

cent to each other can be made to form one picture cell light measuring area, said light measuring elements 

and accordingly 16 picture cells in all. The 16 picture outputing a signal representing the brightness mea- 

cells are properly divided to make several zones. In case 65 sured thereby, 

of such an object of low brightness, the reduction of the dividing said light measuring area into n-number of 

number of picture cells does not affect the light mea- zones of a desired pattern, each zone including at 

surement since the contrast is not so high. least one of said light measuring elements, 
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obtaining an average brightness Bmi (i: address of the 
zone) of said zone by calculation based on the out- 
put signals of said light measuring elements, 

obtaining the object brightness 6 by calculation based 3 
on said average brightness Bmi by use of a formula 
of 
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obtaining the object brightness B by calculation based 
on said average brightness Bmi by use of a formula 
of 



B 



where K 1 and K/+ 1 are coefficients, 

controlling exposure based on the object of bright- 
ness B; and 15 

dividing said light measuring area into different pat- 
terns of zones for different positions of the optical 
instrument to which the method is applied. 

2. A method of controlling exposure based on the ^ 
brightness of an object measured by tight measuring 
means comprising steps of. 

arranging a number of light measuring elements in a 
light measuring area for . measuring die brightness 
of the object the image of which is focused on said 25 
light measuring area, said light measuring elements 
outputing a signal representing the brightness mea- 
sured thereby, 

dividing said light measuring area into n-number of jn 
zones of a desired pattern, each zone including at 
least one of said light measuring elements, 

obtaining an average brightness Bmi (i: address of the 
zone) of said zone by calculation based on the out- 
put signals of said light measuring elements, . 35 



where K 1 and Ki+ 1 are coefficients, 
controlling exposure based on the object of bright- 
ness B; 

dividing said light measuring area into different pat- 
terns of zones for different positions of the optical 
instrument to which the method is applied; and 
dividing said tight measuring area into different pat- 
terns of zones for different kinds of objects. 
3. An exposure control device for controlling expo- 
sure based on the brightness of an object measured by 
light measuring means which measures the brightness of 
the object the image of which is focused on a light 
measuring area wherein the improvement comprises; 
a number of light measuring elements arranged in said 

light measuring area, 
means for obtaining an average output of the outputs 

of said light measuring elements in each zone, 
means for weighting the averaged outputs and sum- 
ming up the weighted outputs, 
means for controlling exposure based on the bright- 
ness of the object obtained by summing up the 
weighted outputs; and 
said light measuring elements being connected to one 
input terminal of an operational amplifier by way 
of analog gates, said analog gates being selectively 
turned on to input desired outputs of the light mea- 
suring elements into said operational amplifier. 
* * » * * 



40 



50 



55 



60 



65 



350-317 
7/20/76 



SR 

3f97lfff65 



United States Patent im 

Bayer 



18602-06614 : A4 
tin 3,971,065 



[45] July 20, 1976 



[54] COLOR IMAGING ARRAY 

[75] Inventor: Bryce E. Bayer, Rochester, N.Y. 

[73] Assignee: Eastman Kodak Company, 
Rochester, N.Y. 

[22] Filed: Mar. 5, 1975 

[211 Appl. No.: 555,477 

[52] VJS* tt 358/41; 350/1 62 SF; 

350/317; 358/44 

[51] lata* HOW 9/24 

[58] Field of Search 358/44,45,46,47, 

358/48; 350/317, 162 SF; 315/169 TV 

[56] References Cited 

UNITED STATES PATENTS 

2,446,791 8/1948 Schroeder 358/44 

2,508,267 5/1950 Kaspcrowicz 358/44 

2,884,483 4/1959 Ehrenhaft et aL 358/44 

3,725,572 4/1973 Kuiokawaeta! — 358/46 

Primary Examiner— George H. libman . 
Attorney, Agent t or Firm— George E. Grosser 



[57] ABSTRACT 
A sensing array for color imaging includes individual 
luminance- and chrominance-sensitive elements that 
are so intermixed that each type of element (i.e., ac- 
cording to sensitivity characteristics) occurs in a re- 
peated pattern with luminance elements dominating 
the array. Preferably, luminance elements occur at 
every other element position to provide a relatively 
high frequency sampling pattern which is uniform in 
two perpendicular directions (e.g., horizontal and ver- 
tical). The chrominance patterns are interlaid there- 
with and fill the remaining element positions to pro- 
vide relatively lower frequencies of sampling. 
In a presently preferred implementation, a mosaic of 
selectively transmissive filters is superposed in 
registration with a solid state imaging array having a 
broad range of light sensitivity, the distribution of 
filter types in the mosaic being in accordance with the 
above-described patterns. 



11 Claims, 10 Drawing Figures 
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ments, respectively). However, in U.S. Pat No. 
COLOR IMAGING ARRAY 2,755,334, also to Banning, a repeated arrangement of 

r Arif rpm run ot? tup iwununnw four eleroent groupings (red-, green-, blue-, and white- 

BACKGROUND OF THE INVENTION sensitive elements, respectively) is described. Such 

1 . Field of the Invention 5 approaches to color imaging have not been of practical 
The invention relates to imaging devices and, in par- significance, in part because of the cost of fabricating 

ticular, to color image sensors. the number of individual elements which are required 

2. Description Relative to the Prior Art to provide image information having adequate detail. 
Color image sensors of various types have been pro- In summary, while color imaging devices having a 

posed for and used in video cameras. To avoid optical 10 single imaging site are desirable to minimize optical 
complexity and problems with image registration, it is and registration problems and to provide a more rug- 
highly desirable that color image sensing occur at a ged camera structure, video camera manufacturers 
single imaging site, e.g., at a single planar photosensi- generally resort to splitting the image beam and provid- 
tive array. Difficulty is encountered, with such "single- ing multiple image scanners in order to achieve a satis- 
site" color imaging, however, because at least three 15 factory type and quality of color video signal, 
distinct types of color information must be extracted in _ _ g . _ „ Txri /xrNrrT^M 

order to represent a color image in video signal form. SUMMARY OF THE INVENTION 

One known approach to providing a single-site color Color imaging is effected by a single imaging array 
sensing device utilizes a single image sensor of broad composed of individual luminance and chrominance 
wavelength sensitivity and a cooperating filter disc 20 sensing elements that are distributed according to type 
which passes a series of color filters through the image (sensitivity) in repeating interlaid patterns, the lumi- 
beam in a repeating sequence. The filter interpositions nance pattern exhibiting the highest frequency of oc- 
are synchronized to image scanning, a filter typically currence — and therefore the highest frequency of 
being interposed during an entire field scan. Devices image sampling — irrespective of direction on the ar- 
ope rating in this manner are said to produce a "field 25 ray. 

sequential" color signal. One problem with this ap- In providing for a dominance of luminance sampling, 
proach is that the resulting signal presents the extracted recognition is taken of the human visual system's rela- 
color image information in a time order which is radi- tively greater ability to discern luminance detail By 
cally different from the time order of the standard arranging the luminance elements of the color image 
NTSC video signal. A further disadvantage is that some 30 sensing array to occur at every other array position, a 
of the color image information (e.g., blue image infor- dominance of luminance elements is achieved in a 
mation if a blue basic color vector is utilized) tends to pattern which has the special advantage of uniforrnity 
be disproportionately detailed and hence wasteful of in two orthogonal directions (e.g., horizontal and verti- 
sensor capacity in consideration of the response char- cal). Moreover, by so mternuxinjg three types of ele- 
acterisdes of the human visual system. 35 ments (luminance, and first and second chrominance) 

Certain other proposed approaches to achieving sin- that luminance elements occur at every other array 
gle-site color image sensing call for the use of striped position, and first and second chrominance elements 
color niters superposed on a single image sensor. One alternate with such luminance elements in respective, 
such type of image sensor utilizes filter grids which are alternate rows of the array, there is provided a himi- 
angularly superimposed on one another (see U.S. Pat 40 nance-dominated sampling which is uniform for aU 
No. 3,378,633). As a result of image scanning, such three color vectors in two orthogonal directions. Cer- 
image sensors produce a composite signal wherein tain desirable sampling attributes which result from the 
chrominance information is represented in the form of special uniformities of such arrangements are discussed 
modulated carrier signals. Such apparatus may be in the detailed description below, 
adapted to produce signals in the NTSC format or, if 45 Preferably, to produce an element array according to 
desired, the color image information can be separated the invention, a solid state sensor array of broad wave- 
by frequency domain techniques. In practice, however, length sensitivity is provided with a superposed filter 
it bas proven difficult to produce such sensors econonv mosaic. Filters of the mosaic are arranged in one-to- 
ically, particularly where detailed image information is one registration with elements of the sensor array and 
required. 50 have light passing characteristics in accordance with 

Striped filters which transmit a repeating sequence of the above-described interlaid pattens. Filters which are 
three or more spectral bands have also been proposed selectively transparent in the green region of the spec- 
for use in color imaging. With this arrangement, the trum are preferably employed in producing luminance- 
filters are typically aligned vertically and scanning of type elements, and filters which are selectively trans- 
the image is performed horizontally, in effect, elemen- 55 parent in the red and blue spectral regions, respec- 
tal sample areas are defined along the filter stripes. tively, are preferably employed in producing chromi- 
With this arrangement, it will be appreciated, sampling nance-type elements. (The term "luminance" is herein 
for a given color is not uniform for horizontal and verti- used in a broad sense to refer to the color vector which 
cal directions. Additionally, the samp.h.^ patterns is the major contributor of luminance information. The 
which result tend to provide a dispropoi'i>'cm*:c quan- *° term ''chrominance" refers to those color vectors other 
tity of information regarding basic coK/r vectors to than the luminance color vectors which provide a basis 
which the eye has less resolving power, e.g., "blue" for defining an image.) 

information relative to "green" information. In an important alternative for implementation of the 

Another approach to color imaging which has been invention, three interlaid patterns, (a green-, a red-, 
proposed is the "dot" scanning system, as discussed in 65 and a blue-sensitive element pattern) are so arranged 
U.S. Pat. No. 2,683,769 to Banning. That approach that green-sensitive elements (serving to detect iumi- 
generally utilizes spectrally selective sensor elements nance) occur at every other array position, with red- 
which are arranged in triads (red, green, and blue ele- sensitive elements alternating with such green-sensitive 
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elements in alternate rows — as in the case for the and uniform in two orthogonal directions (e.g., hori- 
presently preferred implementation. In the remaining zontal and vertical), as is readily seen from FIG. IB. 
element positions, however, blue-sensitive elements FIGS. 2A, 2B, and 2C illustrate the advance over 
alternate with red-sensitive elements to produce a lumi- certain prior art by means of the invention. Referring to 
nance-dominated image sampling having a dispropor- 5 FIGS. 2A, 2B, and 2C, the distance between rows of 
ubn in the chrominance samples favoring red over elements in the horizontal and vertical directions is 
blue. With this arrangement, sampling rates for all shown for the luminance pattern 2 (FIG. 1A), and for 
three basic color vectors are adjusted respective of the prior art striped element patterns (e.g., as would exist 
acuity of the human visual system. That is, blue detail, where a vertically striped filter is superposed on a sen- 
to which the human visual has least resolution, is sam- 10 sor array). Luminance pattern 2 (FIG. 2A) is seen to 
pled the least frequently . . . green detail, to which the provide uniform sampling in the horizontal and vertical 
human visual system is most responsive, is sampled directions, whereas the striped patterns of FIGS. 2B 
most frequently. and 2C do not. (Note: FIG. 2B shows a striped arrange- 

It will be appreciated from the foregoing that with ment having a numerically similar luminance element 
selectively sensitized elements cooperating in interlaid 15 population, and FIG. 2C shows a striped filter of the 
sampling patterns according to the invention, image tv P e navi ng alternating stripes for each of three basic 
information is extracted with an efficient use of sensing c °I° r vectors.) For each row and column of elements, 
elements because relative image sampling rates, by the FIG. 2 A lummance elements (and hence lwninance 
color, are in effect adjusted respective of the character- samples) occur at regular intervals. Moreover, by 
istics of human visual response. Moreover, with the 20 means of invention, not only the luininance pattern, 
uniformities of such interlaid sampling patterns, desir- but 38 otner patterns (4 and 6, FIG. 1 A) of a sensor 
able sampling attributes are achieved for a plurality of according to the invention become regular and uniform 
sensing element types (color sensitivities) cooperating in ^ ortn °gonal directions. 

in a color imaging device. The preferred luminance pattern as especially desir- 

The invention is described with reference to the 25 abIe ^P^g qualities which result from the uniform- 
drawings, wherein: itv ^ orientation thereof. Of the possible patterns 

FIG. 1A is an exploded pictorial representation Eluding only half of the element positions of a sub- 
showing preferred sensing element patterns for practic- stantial ly rectangular array, the preferred pattern is the 
ing the invention; one that affords the largest useful region of frequency 

FIG. IB is a pictorial rcprcscntaion corresponding to 30 Le considering all directions on the array, the 

FIG. I A; minimum Nyqutst limit is largest. Moreover, because of 

FIGS. 2A, 2B, 2C, and 2D are patten representations fc ^ teti <» of * c preferred pattern to the major 

teachmgas^mplmgcharacteristicofprefe^edfo f xe ?' P™* more w . the 

the invention- horizontal and vertical directions . . . those directions 

FIG. 3A is a cross-sectional representation, in part, of 35 whe P. te human M s * stem is ■* to ^ 
a row of sensing elements in accordance with a pre- resolving power. 

ferred implementation of the invention; To forther explain mese sampling qualiUes^efercnce 

FIG. 3B is a cross-sectional representation, in part, of ™ de to * G ; 2 ?> wher / f™? 1 ™* 

arr^em^^ St^oL^ 

S^ittT" 3 Camera SyStem M 7* or usable frequency JegL, Le., the 

iff" ^^^^^^^ « ezssss^ 

block form illustrating signal processing arrangements ^ * ort £ n ^ fr {indicated b { 

Z ITT ^ aCC ° rdmg 10 toe > having its diagonal ahgned with the hori- 

^ « i - *• *u ■ ,. , L zontal and vertical directions (hence extending further 

FIG. 6 is a planar view of another embodiment of the m those directions), 

invention. 50 Refcrring now to j?] GSt 3A ^ 3B a preferrcd m ^ 

JrftCi™ Tt' V? 1B ^ erC a m « VP**** for implementing the invention emplo^ 

set of three sensor patterns 2, 4, and 6, respectively, a S0 Ud state imaging array 20 of the CCD type com- 

which are mterlaid to form an image sampling array 8, priS ed of individual sensor elements (e.g., element 22 

each such pattern corresponding to a different basic extending between the dashed lines of FIG. 3A) A 

color vector. The pattern 2 (hereinafter referred to as 55 filter mosaic 24 is superposed on imaging array 20, 

the luminance pattern) has the highest element popula- which mosaic includes individual filters (e.g., filter 26) 

don, and b made up of luminance-sensitive elements m one-to-one registration with individual sensor ele- 

(denoted O, which are arranged at every other ele- ments of the array (e.g., the element 22). Individual 

ment position. With this oattern, it will be appreciated, filters of mosaic 24, forming a filter mosaic over the 

luminance elements (and hence luminance samples) 60 array 20, are of the selectively transmitting type, and 

occur at halt of the element positions of the array and are arranged in patterns as described above. The letters 

are uniformly distributed over the entire array. First G, R, B on individual filters of mosaic 24 (FIGS. 3A 

*nd second chrominance patterns 4 and 6 alternate and 3B) serve to indicate green, red, and blue light 

with the luminance pattern in alternate rows, respec- transmission characteristics, respectively, as would be 

tively, to provide a composite sampling array devoid of 65 employed according to the presently preferred form of 

overlapping. As a result of this arrangement, sampling the invention. Filters selectively transmissive to light in 

of an image, for all three basic color vectors (i.e., lumi- the green region of the spectrum are utilized in produc- 

nance, first and second chrominance), is symmetrical ing luminance-sensitive elements, and red and blue 
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transmitting filters are used for producing first .and elements. Through this arrangement, image sampling is 

second chrominance-sensitive elements. .' • * , coordinated to closely match the response of the 

A selectively sensitive, color imaging element, such human visual system; however, it will be appreciated 

as element 26, is formed by each one* of filters 24 in that separating and storing red and blue image informa- 

combination with a corresponding array sensor (for 5 tion becomes more complicated when the red and blue 

element 26 the sensor denoted 22). ft will be appreci- patterns differ. 

ated, hbwever;That ah array according to the invention The invention has been described in detail with par- 
might also^ be formed of seraors having'selectrve Wave- ticular. respect »to implementations thereof, but it will 
length sensitivity; or by use of lenticular -filters separate' be appreciated that variations and modifications can be. 
from ah array of sensor elements, which filters select 10 effected within the spirit and scope of, the invention, 
tively limit the wavelengths of light arriving at indrvid- f For example, a variety of sensors might be employed,, 
ual elements of such array. including the sensors of CCD or CID imaging arrays. 

Referrinjg to FIG. 4, a color imaging- array 30 accord- Moreover, color-sensitive elements for use in the in- 
ing to the invention is shown in 4 a. simplified camera 5 , vention may have inherent selective serisittvity or may 
environment. Image information from individual, rowfr: 15 incorporate filters either adjacent to or removed from a. 
of the array, such as a,rbw 32, is transferred to a shift broad-wavelength-range sensor, which filters, selec- . 
register 34 (generally formed "on board" the imaging tively, limit the range of sensitivity for individual sen- 
chip) in response to signals from an interrogating appa- sorSr Also, while the invention is ,cast in the environ-: 
ratus such as a line scan clock 36. Such operation is ment of a camera utilization, it has other uses, for ex- 
well known, and apparatus for performing same is de- 20 ample, in connection with a display device, 
scribed in literature and patents regarding CCD arrays. What is claimed is: 

[t is also generally known to process the output signal 1. A color imaging device comprising an array pf 
of the register by means of a circuit 38. Using color light-sensitive elements, which array includes at least 
imaging arrays according to the invention, however, ( I ) a first type of element sensitive to a spectral region 
information for the various base color vectors is inter- 25 corresponding to luminance, (2) a second type of ele- 
spersed as a result of the intermixed sensitivities of the ment sensitive to one spectral region corresponding to 
color array elements. Accordingly, a switching network chrc^ninance, and (3) a third type of element sensitive 
40 is provided to separate the image signal sequence to to a different spectral region corresponding to chromi- 
a usable form, for example, to parallel green, red, and nance, the three types of elements occurring in repeat- 
blue video signals. 30 ing patterns which are such that over at least a major 

In such form, the signals are conveniently converted portion of said array luminance-type elements occur at 

to NTSC format using a conversion matrix of 2. This is every other element position along both of two orthog- 

especially convenient if the number of rows in the array onal directions of said array, 

corresponds to the number of visible lines in a field 2. A device in accordance with claim 1 wherein said 

scan (approximately 250) or the number of visible lines 3 $ f luminance-type elements are sensitive in the green 

in a frame (approximately 500) comprised of inter- region of the spectrum, and the two types of chromi- 

laced fields. nance elements are sensitive in the red and blue regions 

A simplified diagram for a switching network 30 is of the spectrum, respectively, 

shown in FIG. S. Sample and hold units 50 and 52 are 3. An array in accordance with claim 1 wherein the 
employed in alternating operation to separate out, re- 40.-eiements are arranged in a substantially rectangular 

spectively, green information and the chrominance pattern and the two chrominance types of sensors alter- 

information. The latter alternates between red and blue nate with the luminance sensors in alternate rows, re- 

with each successive row of the array. Since red infor- spectively, of the rectangular pattern, 

mation and blue information is received on an alternat- 4. A color image sensor comprising: 

ing row basis, such information is stored in a register 54 45 • a . a substantially planar array of solid state light-aen- 

for an entire row and shifted out serially as the next sitive elements; and 

row's luminance information arrives. b. a filter mosaic made up of individual filter ele- 
To maintain the same output channels for red infor- ments which are superposed in one-to-one registry 
mation and blue information, irrespective of row, on said tigjrt-sensitive elements, said mosaic being 
switching means 56 alternates the output connection 50 comprised of a first type of filter element having a 
from the register with each row of output information. luminance transparency characteristic, a second 
An important alternative set of patterns for imple- type of filter element having a transparency char- 
meriting color imaging arrays according to the inven- acteristic different from that of said first type, and 
tion is shown in FIG. 6. The luminance (green) pattern, a third type of filter element having a transparency 
having elements denoted by a U G M , assumes every 55 characteristic different from that of said first and 
other array positioa A red pattern, having elements second types, such filter elements being arranged 
denoted by an "R*\ alternates with lunrnance elements in repeating patterns respective of type with the 
(denoted "B") in alternate rows, and red elements also luminance filters occurring at every other array 
alternate with blue elements in filling the remaining position in two perpendicular directions through- 
element positions. By this arrangement, blue elements 60 0 ut substantially the entire imaging area of the 
contribute only one-eighth of the element population . sensor. 

. . a recognition of the human visual system's relatively 5. A sensor according to claim 4 wherein the first 

limited ability to discern blue detail. Red detail, to type filters are arranged at every other array position, 

which the human visual system is more responsive, is and said second and third type filters alternate with the 
sampled at a higher rate than for blue detail by virtue of 65 . first type filters in respective alternate rows of the ar- 

the relatively greater population of red-sensitive ele- ray. 

ments. Luminance detail, to which the human eye is 6. A sensor according to claim 4 wherein the first 

most responsive, is sampled by the largest population of type filters occur at every other array position, and the 
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third type filters occur in alternate rows at every fourth 
position, the second type filters occurring at all remain- 
ing positions, whereby a hierarchy of distributed sam- 
pling populations is provided. 

7. A sensor according to claim 6 wherein the first 5 
type of filter transmits for the green spectral range, the 
second type of filter transmits for the red spectral 
range, and the third type of filter transmits for the blue 
spectral range. 

& A video image sensor comprising a first type of 10 
element sensitive to a luminance region of the spec- 
trum, and a second and a third type of element sensitive 
to respective different chrominance regions of the 
spectrum, said sensor, over substantially the entire 
imaging area thereof, having such elements arranged as 15 
a mosaic of individual groups of four neighboring ele- 
ments in a generally square configuration, which 
groups each include two diagonally-arranged first-type 



8 



elements, one second-type element, and one third-type 
element. 

9. A video image sensor according to claim 8 wherein 
said first-type elements within the individual groups are 
aligned in a common diagonal direction. 

10. A video image sensor according to claim 9 
wherein said first-type element is sensitive to the green 
region of the spectrum, the second-type element is 
sensitive to the red region of the spectrum, and the 
third-type element is sensitive to the blue region of the 
spectrum. 

11. An image sensor according to claim 8 wherein 
individual first-, second-, and third-type elements are 
comprised of a broad spectrum photo responsive device 
with a spectrally selective finer superposed in registry 
therewith. 

* * * * * 
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ABSTRACT 



A printer using a matrix of printing elements arranged 
in a square configuration with the printing elements 
being used to print alpha-numeric data in either a ver- 
tical or horizontal orientation by electronically select- 
ing a rectangular matrix from less man the full number 
of printing elements in the square matrix to permit se- 
lective orientation of the printed data without me- 
chanically reorienting the print head. The print ele- 
ment drive circuitry also enables the printing matrix to 
print from either end of the selected rectangular print 
matrix in either the horizontal or vertical orientation 
to provide four possible orientations of the printed al- 
pha-numeric data. A memory is used to store the input 
control signals for each of the rows of the rectangular 
printing matrix while a control means Is provided for 
reading out the control signals in either direction from 
the memory in combination with a matrix selection 
control to provide energization of a rectangular print 
matrix in either the hori2ontr I or vertical configura- 
tion. 



10 Claims, 3 Drawing Figures 
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input for AND gate 52 is obtained from the sixth stor- ent position in the horizontal print matrix from that in 
age stage of the storage register 45 while a second input the vertical print matrix, e.g., storage position 10 is 
for the AND gate 52 is obtained from the vertical con- used for print elements 2, 2 and 2, 6. 
trol line 66. Concurrently, a first input for the second In FIG. 3, there is shown a block diagram of a control 
AND gate 53 associated with the same print element 2, 5 circuit for the matrix drive circuit shown in FIG. 2. The 
2 is obtained from the tenth storage stage of the storage print element drive pattern which drives the printing 
register 45 while a second input for the AND gate 53 matrix is derived from a read-only memory 70. Thus, 
is obtained from the horizontal control line 65. a particular symbol pattern to be displayed by a 5 X 7 
The output signals from the AND gates 52 and 53 are printing matrix is selected from the read-only memory 
applied to a first OR gate 70 with the output signal from JO 70 by a character code selection signal applied to input 
the OR gate 70 being applied as an energizing signal to lines 72 derived from any suitable source, e.g., an en- 
the print element 2, 2. Thus, for example, the presence coding typewriter keyboard. In the arrangement shown 
of a control signal on the horizontal control line 65 and in FIGS. 2 and 3 the 5 X 7 matrix symbol pattern is read 
the presence of a digital bit stored in the tenth storage out of the memory 70 one row at a time with successive 
stage of the storage register 45 is effective to energize 1 5 memory addresses being required to read out the suc- 
the print element 2, 2 while a control signal on the ver- cessive rows of the pattern data. These successive ad- 
tical control line 66 and a digital bit stored in the sixth dresses are produced by an up-down counter 74. The 
stage of the storage register 45 is effective to, also, en- output signals from the memory are applied in five par- 
ergize the print element 2, 2. It should be noted, how- allel data lines 76 for application to a storage register, 
ever, that the print element 2, 2 is matrix element num- 20 These data lines represent the five col umns of data con- 
ber 6 in the vertical print head orientation and is matrix tained within one row of a 5 X 7 matrix. The output sig- 
element number 10 in the horizontal print head orien- nals from the memory 70 are applied in parallel to 
tation. The print elements 2, 2 to 2, 6 are similarly en- seven frve-bit registers 78 to 90 which are shown in* 
ergized from digital bit signal stored in respective pairs only partial representation in FIG. 3 for the sake of 
of stage" in the register 45 as controlled by the horizon- 25 clarity and which correspond in total to the register 45 
tal and vertical control lines 65 and 66. On the other shown in FIG. 2. However, each of the registers are 
hand, the first print element 2, 1 in the second horizon- successively enabled for loading of the output signals 
tal row is used only in the horizontal rectangular matrix from the read-only memory 70 by successive output 
orientation and is energized by an output signal from signals applied on respective register select lines. For 
the first AND gate 51 in response to a bit stored only 30 example, the first register 78 is enabled by a select sig- 
in the fifth stage of the register 45 and the presence of nal applied on a first register select line 92 while the 
control signal on the horizontal control line 65. Simi- last register 90 is enabled by a register select signal ap- 
larly, the last print element 2, 7 in the second horizon- plied on a select line 104. The select lines 92 to 104 are 
tal row is energized by an output signal from the last successively energized by a decoder circuit 106 which, 
AND gate 62 in response to a bit stored only in the 35th 35 in turn, is driven by a four-bit counter 108. The de- 
stage of the register 45 and the presence of a control coder circuit 106 may be any suitable prior art device 
signal on the horizontal control line 65. This scheme of for translating the count in the counter 103 into succes- 
energizing the print elements is applicable to all of the sive energizations of the select lines 102 to 104. The 
print elements shown in FIG. 1 except those in the first counter 108 and the counter 74 are both driven by 
and last rows, i.e., print elements 1, 1 to 1,7 and print 40 clock signals from a clock source 110 supplied over a 
elements 7, 1 to 7, 7 and those in the first and last col- clock signal line 112. Similarly, the counter 74 and 108 
umns, elements 1, 1 to 7, 1 and elements 1, 7 to 7, 7. are "cleared" by a "clear" signal from the clock source 
Specifically, the corner print elements I, 1; I, 7; 7, 1 110 applied on a clear signal line 114. The signals from 
and 7, 7 may be either unused or selectively energized the clock 110 are initiated upon receipt of a "strobe" 
to provide special print notations by any suitable cir- 45 pulse on a strobe input line 116 from any suitable 
cuits (not shown) since these print elements do not means (not shown) which is used to initiate the printing 
form a part of either rectangular print matrix. Addi- cycle after the selection signals on lines 72 are applied 
tionally, the remaining print elements first and last to the memory 70. 

rows, i.e., print element 1, 2 to 1, 6 and print elements In operation, the control circuit shown in FIG. 3 is 
7, 2 to 7, 6 are used only in the vertical orientation and, effective to start the printing of a character after the se- 
accordingly, are energized by the concurrent presence lection of a character by the signals on lines 72 by a 
of a vertical control signal and a digital bit stored in the "strobe" pulse applied on the strobe line 1 16 to the 
stage of the register 45 corresponding to the position of clock 1 10. The "strobe" may be derived from the same 
these print elements in the vertical print matrix as iden- . . source used to produce the selection signals on lines 72 
titled by the reference numbers in FIG. 1. The vertical and may be applied concurrently therewith to the cir- 
control signal and digital bits for controllinp rh print cuit shown in RG. 3. This "strobe" pulse produces a 
elements would be applied to AND ga.v; in a manne r "clear" pulse from the clock 1 10 which is applied to 
similar to that descriherl above for ^N'P <zatcs 51 anc ! the counters 74 and 108. Subsequently, the clock 110 
62 shown in FIG 2. Similarly, the print - ^ments in thr 60 is arranged to produce a burst of seven clock pulses on 
first and last columns 2, 1 to 6, I and 7 to 6, 7 ait- clock line 112 for application to the counters 74 and 
used only in a horizontal orientation and. accordingly- 108 to increment the counters concurrently. The suc- 
are energized by the concurrent presence of a horizoi.- cessive count signals stored in the counter 108 in re- 
tal control signal and a digital bit stored in the stage of sponse to the clock pulses are decoded by the decoder 
the register 45 corresponding to the position of these 65 106 to successively enable the registers 78 to 90. Con- 
print elements in the horizontal print matrix. Finally, it currently, the clock signals applied to the counter 74 
should be noted that a storage position in the register are applied to the read-only memory 70 as address sig- 
45 may be used to energize a print element in a differ- nals for each of the seven rows of the data pattern for 
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a 5 x 7 matrix which has been selected by the input sig- lively connected to either the fourth and fifth ones of 
nais on input lines 72. In order to further increase the the output lines 76 or the first and second ones of the 
printing abilities of the printer, the counter 74 is ar- output lines 76. The aforesaid interchange of the first 
ranged to be an up-down counter which under control and second output tines of the ROM 70 with the fourth 
of an up-down control signal applied on a control line 5 and fifth output lines of the ROM 70 are effected con- 

1 18 will either increment or decrement its count with currently by a signal on either one of the control lines 

the receipt of each clock pulse on clock line 1 12. In 146 and 148. This interchange has the net effect of ro- 

other words, when the up-down counter 74 is in an up- tating the character pattern around the pattern center 

count mode, the rows in the read-only memory 70 for represented by the third output line from the ROM 70 

the selected character pattern are read out in order 10 which is connected directly to the third output line of 

from 1 through 7. Conversely, when the counter 70 is the output lines 76. The control signals on the control 

in a count-down mode, the selected character pattern lines 146 and 148 are related to the up-down control 

in the read-only memory 70 is read out in order from signal on the up-down control line 118 since in the 

row 7 through 1. Therefore, in the count-down mode count-up mode of operation of the counter 74, the 

of the counter 74 the data pattern from the read-only 15 "normal" control signal on line 146 would be applied 

memory is read out to print a character which the re- to control the routing of the output signals from the 

verse of a character printed by a count-up mode of the ROM 70 while the "reverse" control signal on line 148 

counter 74. Accordingly, the combination of the signal would be applied during the count-down mode of oper- 

on the up-down control line 118 and the vertical and ation of the counter 74. 

horizontal control as shown in FIG. 2 permit a 5 x 7 20 Accordingly, it may be seen that there has been pro- 
character pattern to be displayed in any one of four vided, in accordance with the present invention, an im- 
possible orientations, i.e., the character can be normal proved matrix printer for printing alpha-numeric data 
or reversed in the horizontal print configuration and oriented along a vertical axis as well as a horizontal axis * 
either normal or reversed in the vertical print configu- without involving mechanical reorientation of a print 
ration. 25 head. 

In order to correctly print the characters in the re- The embodiments of the invention in which an exclu- 

versed mode in either the horizontal or vertical config- sive property or privilege is claimed are defined as fol- 

uration to avoid a mirror-image printing, the circuit lows: 

shown in FIG. 3 uses a set of AND-OR gates 120 inter- 1. A printer comprising: 

posed in the output lines 76 from the ROM 70 to pro- 30 a print head having a fixed spatial arrangement of a 

duce either a left-to-right or a top-to-bottom reversal of plurality of printing elements, 

the character pattern. Specifically, the first output line selection means for selecting a plurality of groups of 

from the ROM 70 is connected to a first AND gate 122 said printing elements out of said fixed spatial ar- 

and a second AND gate 124. A second output line from rangement to form each of a corresponding plural- 

the ROM 70 is connected to a third AND gate 126 and 35 ity of printing matrices with each of said plurality 

a fourth AND gate 128. The third output line from the of printing matrices being rotatably displaced from 

ROM 70 is passed directly to the output lines 76 since any other one of said plurality of printing matrices, 
it determines the center of the character which is not 

affected by the reversed mode. The fourth output line energizing means for generating energizing signals 

from the ROM 70 is connected to a fifth AND gate 130 40 for said printing elements to actuate said printing 

and a sixth AND gate 132. The fifth output line from elements to form corresponding printed represen- 

the ROM 70 is connected to a seventh AND gate 134 tations by said printing elements, and 

and an eight AND gate 136. The outputs of the first and energizing signal means for selectively applying said 

eight AND gates 122 and 134 are connected to a first energizing signals to said printing elements in a 

OR gate 138 having an output line connected to a first 45 printing matrix selected by said selection means 

one of the output lines 76. The outputs from the third from said plurality of printing matrices. 

AND gate 126 and the fifth AND gate 130 are con- 2. A printer as set forth in claim 1 wherein said fixed 

nected to a second OR gate 140 having its output line spatial arrangement is a square with the same number 

connected to a second one of the output lines 76. The of printing elements on each side of the square and 

outputs from the sixth AND gate 132 and the fourth each printing matrix selected by said selection means 

AND gate 128 are connected to a third OR gate 142 from said plurality of printing matrices is a rectangle 

having its output connected to a fourth one of the out- with a different number of printing elements on adja- 

put lines 76. Finally, the output of the eighth AND gate cent sides of the rectangle and 

136 and the second AND gate 124 are connected to a including control means selectively operable to con- 
fourth OR gate 144 having its output connected to fifth trol said selection means for switching between a 
one of the output lines 76. A pair of control signal lines first rectangular printing matrix and a second rect- 
146 and 148 are used to control the normal and re- angular printing matrix rotatably displaced from 
s :ised mode of operation, respectively. These control said first rectangular printing matrix, 
lines 146 and 148 are used to apply energizing signals 6Q 3. A printer as set forth in claim 1 wherein each sc- 
to predetermined ones of the AND gates in the set of lected print matrix has less than all of the available 
A N D-OR ga tes 1 20 to route the output signals from the print elements. 

ROM 70 to desired ones of the output lines 76. 4. A printer as set forth in claim 1 wherein said fixed 

Specifically, the "normal" control line 146 is con- spatial arrangement is a square with the same number 

nected to the AND gates 122, 126, 132 and 136 while 65 of printing elements on each side of the square and said 

the "reverse "control line 148 is connected to the AND printing matrix is a rectangle with a different number 

gates 124, 128, 130 and 134. Consequently, the first of printing elements on adjacent sides of the rectangle 

and second output lines of the ROM 70 can be selec- and including a control means selectively operable to 
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control said selection means for switching between a are read out in either a first sequence during an up 

first rectangular printing matrix and a second rectangu- counting operation of said counter or a second se- 

lar printing matrix angularly displaced from said first quence during a down counting operation of said 

rectangular printing matrix. counter. 

5. A print as set forth in claim 4 wherein said first and 5 9. A printer as set forth in claim 4 wherein said ener- 

second rectangular pnnting matrices of printing ele- gizing means includes a memory means for storing con- 

ments have the same number of print elements trol signals for said print elements and readout means 

90° from each other. P m ™"«y means 35 energizmg signals for application to 

7. A printer as set forth in claim 1 wherein said ener- the prmting elements selected by said selection means, 
giring means includes a memory means for storing con- , A A . A ^ r . . , . _ . . 

trol signals for said print elements and readout means A pnnter . * "f forth m claim 9 wherem said 

arranged to read out said control signals from said readou * !" c,udes 311 u M own count «[ arranged 
memory means for application to the printing elements 15 to read f" 1 ■ md 00111101 from 881(1 memory 

selected by said selection means as energizing signals. means ' ** n ™ g eneratin S ***** means for applying 

output signals from said signal generating means to said 

8. A printer as set forth in claim 7 wherein said read- "P-down counter to be counted thereby and means for 
out means includes an up-down counter arranged to controlling the counting direction of said up-down 
read out said control signals from said memory means, 20 co . unter durin 8 counting of the output signals from 
signal generating means, means for applying output sig- ^'d signal generating means and means for applying 
nals from said signal generating means to said up-down count signals stored in said up-down counter means to 
counter to be counted thereby and means for control- said memory means to readout said control signals 
ling the counting direction of said up-down counter from said memory means in response to said count sig- 
during the counting of the output signals from said sig- 25 whereby said control signals from said memory 
nal generating means and means for applying count sig- means are read out in either a first sequence during an 
nals stored in said up-down counter means to said up counting operation of said counter or a second se- 
memory means to readout said control signals from quence during a down counting operation of said 
said memory means in response to said count signals counter. 

whereby said control signals from said memory means 30 ***** 
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(54) VIDEO TELEPHONE SYSTEM 

(11) 4-120889 (A) (43) 21.4.1992 (19) JP 
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(71) HITACHI LTD (72) KATSUMI OKUMA(2) 

(51) Int. CP. H04N7/14.H04N5/225 



PURPOSE: To unnecessitate any external device and to miniaturize the system 
by providing a routing mechanism to be rotated within one piane and a control 
circuit for changing an order to read a frame memory. 

CONSTITUTION: This system is equipped with a television camera 1, 
preprocessing circuit 2, frame memories 3 and 7, encoder circuit 4, transmission 
interface 5, decoder circuit 6, post-processing circuit 8, display 9, transmission 
line 10, addresses 11 and 13, frame memory address control circuits 12 and 
14 and main body 15 of a telephone set. When inputting a drawing, the direction 
of the television camera 1 is axially rotated within one frame in comparison 
with the case of inputting the own image of a speaker by an image pickup 
direction rotation part 20, and according to the direction of an object, the order 
to read or write picture signals from the television camera 1 to the frame 
memories 3 and 7 is changed. Thus, any additive device is unnecessitated, and 
system scale can be reduced as a whole. 




f 21: image pickup direction rotation detection part. 22 oojecr 
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